3 lessons
GPU Architecture for Inference
What is actually inside the chip your model runs on, explained simply — and why its memory, not its math speed, usually decides how fast you get an answer.
Kernel Fusion and Compilation
Why running a model "as written" leaves speed on the table, and how compilers rewrite it into far fewer, larger steps without changing the answer.
FlashAttention and IO-Aware Kernels
How rewriting attention to avoid ever writing its biggest intermediate result to slow memory made long-context models practical.