in-context learning

In-context learning is a model's ability to perform a new task from examples given in its input, without additional training.

1 articleLast mentioned

In-context learning is the ability to carry out a new task using only the instructions and examples placed in the prompt, without changing the model's weights. It became widely known through large language models, and few-shot prompting with a handful of examples is the typical form.

Unlike fine-tuning, which retrains the model, it needs little setup time. In robot AI it is also used by showing a demonstration of a person doing a task and having the robot follow it.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Temperature, Attention and Context Rot: Model Mechanics Behind Agent DesignAI in Practice ·

    …n the middle is LLM adaptation: supervised fine-tuning, distillation, in-context learning, LoRA (a method for cheaply fine-tuning a model by training small low-…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.