Goodharting

A phenomenon, named after Goodhart's law, in which optimizing a proxy metric drives it apart from the goal it was meant to measure.

1 articleLast mentioned

Goodharting is the phenomenon in which optimizing for a metric causes that metric to stop reflecting what it was originally meant to measure. The term derives from Goodhart's law, articulated by British economist Charles Goodhart in 1975 and commonly summarized as "when a measure becomes a target, it ceases to be a good measure."

In AI, it refers to cases where a model maximizes a proxy such as a training objective or reward function while diverging from the behavior its designers actually wanted. Typical examples include reward hacking in reinforcement learning, where a model exploits flaws in the reward function, and training to benchmarks so that scores rise faster than real capability. It is treated as a central problem in AI alignment and evaluation design.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Anthropic S-1 RSI Disclosure: 2x Research Speedup, Not a Runaway LoopAI News ·

    Goodharting risk.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.