██████╗ ██████╗ ██╗   ██╗
██╔════╝ ██╔══██╗██║   ██║
██║  ███╗██████╔╝██║   ██║
██║   ██║██╔═══╝ ██║   ██║
╚██████╔╝██║     ╚██████╔╝
 ╚═════╝ ╚═╝      ╚═════╝
 ██████╗ ██╗      ██████╗ ███████╗███████╗ █████╗ ██████╗ ██╗   ██╗
██╔════╝ ██║     ██╔═══██╗██╔════╝██╔════╝██╔══██╗██╔══██╗╚██╗ ██╔╝
██║  ███╗██║     ██║   ██║███████╗███████╗███████║██████╔╝ ╚████╔╝
██║   ██║██║     ██║   ██║╚════██║╚════██║██╔══██║██╔══██╗  ╚██╔╝
╚██████╔╝███████╗╚██████╔╝███████║███████║██║  ██║██║  ██║   ██║
 ╚═════╝ ╚══════╝ ╚═════╝ ╚══════╝╚══════╝╚═╝  ╚═╝╚═╝  ╚═╝   ╚═╝
 

We wrote this glossary to solve a problem we ran into working with GPUs here at
Modal : the documentation is fragmented, making it difficult to connect
concepts at different levels of the stack, like
Streaming Multiprocessor Architecture ,
Compute Capability , and
nvcc compiler flags .

So we’ve read the
PDFs from NVIDIA ,
lurked in the good Discords , and even bought
dead-tree textbooks
to put together a glossary that spans the whole stack in one place.

This glossary, unlike a PDF or a Discord or a book, is a hypertext document —
all pages are inter-linked with one another, so you can jump down to read about
the Warp Scheduler so you can
better understand the threads that you
came across in the article on the
CUDA programming model .

You can also read it linearly. To navigate between pages, use the arrow keys,
the arrows at the bottom of each page, or the table of contents (in the sidebar
on desktop or in the hamburger menu on mobile).