Vals AI

Vals AI is a US company that independently evaluates large language models and AI products and publishes benchmarks.

1 articleLast mentioned

Vals AI is a US company that evaluates large language models (LLMs) and the AI products built on them as an independent third party. Founded in 2023, it is headquartered in San Francisco, California. The company builds benchmarks for specific professional domains such as law, finance, tax, and coding, and publishes the results for each model on public leaderboards.

Its evaluations are run separately from the scores that model developers report themselves, with multiple models tested under the same conditions by an outside party. Part of its evaluation data is kept private so that test questions do not end up in model training data. The company is also known for the Vals Legal AI Report, which compared legal AI products against the work of lawyers.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • GPT-6.2 Astra: Cheaper per Task and Strong in 3D, but Not the Top ModelAI News ·

    Independent evaluator Vals AI scored Astra at 29.01% on its RSI Index, an automated research benchmark calibrated so that 50% indicates human-level performance,…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.