[KongchangAI]
Benchmark

Vals Index

A comprehensive large language model evaluation leaderboard published by Vals AI, ranking multiple models according to their measured capabilities across various benchmarks.

Core Facts

Timeline (last 90 days)

Oct 24

Most Vals Index questions come from real work scenarios and require models to complete multi-step reasoning, data verification, and compliance judgments, unlike the general-purpose MMLU or GSM8K.

Unverified50%
Oct 24

Vals Index is a benchmark released by third-party evaluation organization Vals, specifically measuring AI model performance on highly professional white-collar tasks such as finance, programming, law, and tax.

Unverified50%
Oct 20

Gemini 4 Argon ranks first on the Vals Index knowledge-work leaderboard, and its cost is significantly lower than the second- and third-place entries.

Unverified50%
Oct 19

Vals Index is a comprehensive knowledge-work ranking maintained by a third party, covering multi-step tasks such as writing, analysis, and research, and is not an academic benchmark.

Unverified50%
Oct 18

Gemini 4 Argon tops the Vals Index, a test covering real-work tasks across 43 models.

Unverified50%
Oct 14

On the Vals Index, Argon ranks first and Opus ranks third.

Expired50%
Oct 14

Gemini 4 Argon ranks first on the independent Vals Index leaderboard with a composite score of 89.4%, surpassing Anthropic Claude 4.5 Opus (85.2%) and OpenAI o1 (84.1%).

Expired70%
Oct 14

Vals Index is a comprehensive index launched by the independent evaluation organization Vals AI, which weights and aggregates results from multiple task categories such as finance, programming, law and tax into a single score, without relying on vendor self-reported data.

Unverified50%
Oct 14

The evaluation methods of leaderboards like Vals Index mostly focus on short outputs or medium-length outputs, with a single output rarely exceeding a few thousand tokens, so the capability for million-token outputs is hard to directly reflect in leaderboard scores.

Unverified50%
Oct 14

Vals Index is a comprehensive large-model evaluation leaderboard, typically covering multi-dimensional tasks such as reasoning, knowledge, programming, and mathematics, and giving rankings in the form of weighted scores.

Unverified50%

3 more timeline events

All Facts (9)

Verified

Gemini 4 Argon scored 91% on LV Bench (video/long-content understanding), setting a new record.

70%
Unverified

Most Vals Index questions come from real work scenarios and require models to complete multi-step reasoning, data verification, and compliance judgments, unlike the general-purpose MMLU or GSM8K.

50%
Unverified

Vals Index is a benchmark released by third-party evaluation organization Vals, specifically measuring AI model performance on highly professional white-collar tasks such as finance, programming, law, and tax.

50%
Unverified

Gemini 4 Argon ranks first on the Vals Index knowledge-work leaderboard, and its cost is significantly lower than the second- and third-place entries.

50%
Unverified

Vals Index is a comprehensive knowledge-work ranking maintained by a third party, covering multi-step tasks such as writing, analysis, and research, and is not an academic benchmark.

50%
Unverified

Gemini 4 Argon tops the Vals Index, a test covering real-work tasks across 43 models.

50%
Unverified

Vals Index is a comprehensive index launched by the independent evaluation organization Vals AI, which weights and aggregates results from multiple task categories such as finance, programming, law and tax into a single score, without relying on vendor self-reported data.

50%
Unverified

Vals Index is a comprehensive large-model evaluation leaderboard, typically covering multi-dimensional tasks such as reasoning, knowledge, programming, and mathematics, and giving rankings in the form of weighted scores.

50%
Unverified

The evaluation methods of leaderboards like Vals Index mostly focus on short outputs or medium-length outputs, with a single output rarely exceeding a few thousand tokens, so the capability for million-token outputs is hard to directly reflect in leaderboard scores.

50%

Source Articles