OPRO

OPRO is an optimization method that shows a language model earlier candidates and their scores and asks it to produce better ones, used mainly to improve prompts automatically.

1 articleLast mentioned

OPRO (Optimization by PROmpting) is an optimization method proposed by Google DeepMind researchers in the 2023 paper "Large Language Models as Optimizers." The optimization problem is described in natural language, and previously generated solutions with their scores are placed in a meta-prompt given to a language model, which is asked to produce new solutions that score higher. The new solutions are evaluated and added back to the meta-prompt, and the cycle repeats.

Its best-known application is prompt optimization, in which the model itself searches for instructions that raise accuracy on a task. Because it relies only on model outputs and scores rather than gradients, it can be applied to models accessible only through an API.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • AI Agent Tuning: When to Rewrite Prompts and When to Retrain WeightsAI Performance ·

    It came from OPRO, a Google DeepMind method in which a language model acts as the optimizer: it reads earlier instructions together with their scores and propos…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.