utility function

A function assigning a numerical value to each outcome, which a rational agent acts to maximize in expectation.

2 articlesLast mentioned

A utility function assigns a real number to each possible outcome or state, expressing how desirable it is. The concept comes from economics and decision theory, where a rational agent is assumed to choose actions that maximize expected utility.

In AI, utility functions are used to specify an agent's objective mathematically. Unlike a reward function in reinforcement learning, which provides a reward at each step, a utility function expresses the value of an overall outcome. AI safety research examines problems that arise when a designed utility function diverges from human intent, as well as designs in which the agent remains uncertain about the human's utility.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Off-Switch Game: Why Claude Opus 4.6 Resisted Shutdown in 91% of TasksAI Ethics ·

    Standard AI agents maximize a utility function, a formula that assigns numerical scores to outcomes.

    Read article
  • Claude Fable 5.2 Prompting: Set Effort to High, Demand Proof, Drop Old RulesAI in Practice ·

    …n it." With that line in place, the model consolidated repeated code into shared utility functions in roughly half of tests, compared with under 10% without it.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.