OOLONG

A long-context benchmark that measures how well a model reads and aggregates information scattered across a long input.

1 articleLast mentioned

OOLONG is a long-context benchmark, released in 2025, that measures how well a language model reads and aggregates information scattered across a long context to answer questions. Unlike needle-in-a-haystack tasks that look for a single passage, its tasks require processing many items in the context one by one and aggregating or reasoning over them.

It is used to show how model scores drop sharply as context length grows and to evaluate long-context processing techniques.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Temperature, Attention and Context Rot: Model Mechanics Behind Agent DesignAI in Practice ·

    On the OOLONG benchmark, which tests reasoning and aggregation across many documents, scores for leading models including Gemini 2.5 Pro, Claude Sonnet 4 and GP…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.