ByteShape

ByteShape is an AI company that distributes open LLM weights compressed with its own quantization technology, ShapeLearn.

1 articleLast mentioned

ByteShape is an AI company specializing in the quantization of large language models, the technique of compressing model weights to fewer bits to reduce memory use. It publishes GGUF files of open models compressed to low bit widths with its own ShapeLearn technology on Hugging Face.

The models ByteShape releases are intended for local inference servers such as llama.cpp, with the aim of running large models on a single consumer-grade GPU.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • ShapeLearn Qwen3.8-27B on a 16GB GPU: Agent Tests Pass 4 of 5 at 128k ContextAI Performance ·

    ByteShape's ShapeLearn quantization of Qwen3.8-27B, in its IQ3XS variant at roughly 3.01 bits per weight, achieved that on a modest home server and then went th…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.