regression test

Software testing that reruns existing tests after a code change to confirm that previously working functionality still works.

5 articlesLast mentioned

A regression test is the rerunning of existing tests after a software change to confirm that functionality that previously worked still works. The purpose is to catch regressions, cases where a bug fix or new feature unintentionally breaks another part of the program. Regression tests are usually automated unit and integration tests that run whenever code changes.

In the AI field, regression tests serve as a benchmark for judging the quality of patches produced by AI coding agents, distinguishing a patch that merely stops a crash from one that also passes the project's existing test suite.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Levi Strauss Cuts App Delivery From 9 Months to 2.5 With GitHub Copilot AgentsAI in Practice ·

    …ur weeks and sometimes months because of cross-functional alignment, and QA regression testing consistently consumed three weeks at the very end of every cycle.

    Read article
  • Prompt Audits and Cache Reuse Cut Claude Costs Up to 72.9%, Anthropic SaysAI in Practice ·

    …ir time designing evals and tasks that Claude optimizes overnight, with production failure traces flowing into offline eval sets and then into regression tests.

    Read article
  • T-Shirt Brand Hands Support, Email, Design and Ads to Four AI AgentsAI Startups ·

    Evals also serve as a regression test.

    Read article
  • AI Vulnerability Discovery Outpaces Patching: Where the New Security Gap LiesAI Security ·

    The researchers instead ran AI patches against the regression test suites that human maintainers had written for the projects.

    Read article
  • AI Agents Tie Elasticsearch Incident Analysis to Reviewed Cluster ChangesAI in Practice ·

    It traced the errors to an intermittent exception in a FastAPI endpoint, then prepared a GitHub pull request with a code fix and regression tests.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.