bilevel optimization

An optimization problem in which one optimization problem is nested inside another as a constraint.

1 articleLast mentioned

Bilevel optimization is an optimization problem in which the objective of an outer (upper-level) problem depends on the solution of an inner (lower-level) optimization problem. The upper level sets parameters, the lower level optimizes its own objective under those parameters, and the upper level adjusts the parameters based on the result. It has been studied in mathematical programming since the 1970s and shares its structure with the Stackelberg game in economics.

In machine learning the framework is used for hyperparameter optimization, meta-learning, and neural architecture search, among other tasks. Model training corresponds to the inner problem and the choice of training configuration to the outer problem; methods for passing or approximating gradients through the inner solution are an active research topic.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Self-Improving Agent Design: Two Loops, Versioned Harnesses, Sealed EvaluatorsAI in Practice ·

    Mathematically this is bilevel optimization: an outer objective chooses settings that govern an inner optimization problem.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.