DeepGEMM

DeepGEMM is an FP8 matrix multiplication (GEMM) kernel library released by DeepSeek in 2025 that supports both dense and MoE models.

1 articleLast mentioned

DeepGEMM is an open-source matrix multiplication kernel library developed by the Chinese AI company DeepSeek. It is designed to perform GEMM (general matrix multiplication), the dominant computation in training and inference of large language models, efficiently at FP8 precision, and was released in February 2025 during DeepSeek's open-source week.

It supports both standard GEMM for dense models and grouped GEMM that batches per-expert computations in MoE models, and compiles its kernels at runtime. It is one of the libraries on which DeepSeek's inference engine DeepInfer is built.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • DeepSeek Opens DeepInfer Serving Engine Alongside MIT-Licensed V4.1-FlashAI News ·

    DeepGEMM, a library for the matrix multiplications that dominate model compute

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.