differential privacy

A mathematical privacy standard that adds controlled noise so that no individual record's presence can be inferred from the results

1 articleLast mentioned

Differential privacy is a mathematical privacy standard that guarantees the presence or absence of any individual's record in a dataset cannot be inferred from analysis results or released data. It adds controlled noise to outputs so that the influence of any single record stays within a bound, expressed as a privacy budget (epsilon). The concept was introduced by Cynthia Dwork and colleagues in 2006.

Unlike de-identification that merely removes identifiers such as names, it offers a mathematically guaranteed defense against attacks that re-identify individuals by cross-referencing other data. In AI, common applications include applying differential privacy during training (DP-SGD) and generating differentially private synthetic data, which preserves the statistical properties of the original while severing links to individual records, for use in model training. Apple, Google and the U.S. Census Bureau have applied the technique to data collection and statistical releases.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Open Agent Safety Platform: Deterministic Guardrails for Autonomous AI AgentsAI Security ·

    Instead they should train on, or query, differentially private synthetic data: artificial records that preserve the statistical patterns of the original dataset…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.