DeepGEMM

A clean, performant FP8 GEMM library built specifically for Hopper Tensor Cores. Supports both standard continuous GEMM and fine-grained grouped MoE GEMMs with fine-grained per-tile scaling, achieving over 95% of theoretical peak FP8 tensor core throughput.

https://github.com/deepseek-ai/DeepGEMM

• Implements fine-grained 128x128 tile scaling to prevent FP8 underflow and dynamic range clipping.
• Supports grouped GEMMs to execute all MoE expert calculations in a single unified kernel launch.
• Under 300 lines of core CUDA kernel code, emphasizing readability and extreme performance.

All libraries