Needle-in-a-Haystack
Needle-in-a-Haystack is a long-context evaluation that checks whether a language model can find a short piece of information hidden in a long document.
1 article
Last mentioned The test places a specific sentence or passkey at various positions in long, unrelated text and asks the model to retrieve it. Accuracy is measured by context length and hiding position, and the method is used to check how well a large language model actually uses its context window.
This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.