tau2-bench (τ²-bench) is a benchmark that evaluates how well an AI agent completes tasks by conversing with a user and calling tools. Released in 2025 by the US AI startup Sierra as the successor to its 2024 τ-bench, it consists of customer-service tasks in domains such as airline, retail, and telecom, in which the agent must handle user requests while following domain policy rules.
The user is simulated by a language model. Unlike Ï„-bench, the user can also operate tools, so the benchmark covers two-sided situations in which the agent must guide the user through a procedure. Reliability is measured by running the same task multiple times and counting how often all runs succeed. The benchmark is widely used to compare agents' tool use and policy adherence.