FlashMLA

FlashMLA is an efficient GPU decoding kernel library for Multi-head Latent Attention, released by DeepSeek in 2025.

1 articleLast mentioned

FlashMLA is an open-source GPU kernel library developed by the Chinese AI company DeepSeek. It is designed to run the decoding stage of Multi-head Latent Attention (MLA), the attention mechanism used in DeepSeek's models, efficiently on NVIDIA GPUs, and was first released in February 2025 during DeepSeek's open-source week.

It supports variable-length sequences and a paged KV cache, and is one of the kernel libraries on which DeepSeek's inference engine DeepInfer is built.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • DeepSeek Opens DeepInfer Serving Engine Alongside MIT-Licensed V4.1-FlashAI News ·

    FlashMLA, a GPU kernel library for multi-head latent attention

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.