SLM

A language model with far fewer parameters than a large language model, small enough to run on a single GPU or on a device.

2 articlesLast mentioned

A small language model (SLM) is a language model with far fewer parameters than a large language model. There is no fixed threshold, but SLMs generally range from hundreds of millions to a few billion parameters and can run on a single GPU or on devices such as laptops and smartphones. Representative examples include Microsoft's Phi, Google's Gemma, and the smaller Qwen models from Alibaba.

Although their general capabilities fall short of frontier LLMs, SLMs offer advantages in latency, cost, and privacy and are used in on-device AI and on-premises environments. They are often fine-tuned into specialized models for narrowly defined tasks such as classification, routing, and extraction, and serve as components that reduce calls to larger models in agent systems.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • GPT-6.2 Astra: Cheaper per Task and Strong in 3D, but Not the Top ModelAI News ·

    …els (performance-critical code) for accelerator chips, and speeding up NanoGPT pretraining scripts, which handle the initial training of a small language model.

    Read article
  • Intelligence Plane: Why Memory and Ontology, Not the Model, Define AI AgentsAI in Practice ·

    …and MCP servers (Model Context Protocol, a standard for connecting agents to tools), to large and small language models, and to enterprise tables and documents.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.