overfitting

The phenomenon in which a model fits its training data so closely that it performs worse on new data.

1 articleLast mentioned

Overfitting is the phenomenon in which a machine learning model fits its training data too closely, learning noise and incidental features rather than the general patterns in the data. As a result the model performs well on the training data but worse on data it has not seen. The opposite case, in which a model is too simple to fit even the training data, is called underfitting.

It typically occurs when the data is small relative to the model's complexity or when training runs too long. To counter it, performance is measured on validation data separate from the training set, and techniques such as regularization, dropout, early stopping, and data augmentation are used. The term also describes a model or system being tuned repeatedly against the same benchmark until it fits only that benchmark.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Prompt Audits and Cache Reuse Cut Claude Costs Up to 72.9%, Anthropic SaysAI in Practice ·

    The flip side is that prompts are the easiest surface to overfit, which is why the train/test split is treated as mandatory.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.