FlashMLA
An ultra-fast decoding kernel tailored specifically for Multi-Head Latent Attention (MLA) on NVIDIA Hopper architectures. Employs Tensor Memory Accelerator (TMA) asynchronous memory copies to maximize memory bandwidth utilization during variable-length generation.
https://github.com/deepseek-ai/FlashMLA
- Optimized for variable sequence length decoding on H800/H100/H200 GPUs.
- Takes full advantage of Hopper TMA hardware features for zero-copy global-to-shared memory transfers.
- The repository describes optimized MLA kernels. A 300–355 tok/s claim for V4.1-Flash was removed because it is not on the model card.