FlashAttention and IO-Aware Kernels
How rewriting attention to avoid ever writing its biggest intermediate result to slow memory made long-context models practical.
10 min readUpdated 2026-09-03ai-inferenceflashattentionattentionkernel-fusion
How rewriting attention to avoid ever writing its biggest intermediate result to slow memory made long-context models practical.