ShapeLearn

ShapeLearn is an LLM quantization technology developed by ByteShape that learns the most suitable data format for each tensor.

1 articleLast mentioned

ShapeLearn is a quantization technology for large language models developed by ByteShape. Instead of applying a single bit width across the whole model, it uses a hybrid quantization approach that learns the most suitable data format for each tensor.

It aims to preserve model quality at very low bit widths, in the range of two to four bits. Models compressed with ShapeLearn are distributed in the GGUF format for local inference environments such as llama.cpp.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • ShapeLearn Qwen3.8-27B on a 16GB GPU: Agent Tests Pass 4 of 5 at 128k ContextAI Performance ·

    ByteShape's ShapeLearn quantization of Qwen3.8-27B, in its IQ3XS variant at roughly 3.01 bits per weight, achieved that on a modest home server and then went th…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.