GSM8K

GSM8K is a benchmark of about 8,500 grade-school math word problems used to measure the multi-step arithmetic reasoning of language models.

1 articleLast mentioned

GSM8K (Grade School Math 8K) is a dataset of math word problems released by OpenAI researchers in 2021. It contains about 8,500 human-written problems at grade-school level, each requiring between two and eight steps of basic arithmetic to solve. Every problem comes with a step-by-step solution in natural language and a final answer.

It has been widely used as a benchmark for multi-step arithmetic reasoning in language models and is a common evaluation target in research on prompting techniques such as chain-of-thought.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • AI Agent Tuning: When to Rewrite Prompts and When to Retrain WeightsAI Performance ·

    Consider three endings appended to a math problem and tested on a Google PaLM 2 model with the GSM8K math benchmark.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.