AI model benchmarks · the judgment layer

Every new AI model’s benchmark chart
says “we win.”

The maker draws it, and most of the gaps on it are noise. We read each release and tell you which differences are real — and which you should ignore.

77%
independently verified
51
AI models tracked
14
benchmarks
No composite score. Ever.

Three things a leaderboard won’t tell you — live from today’s data

$1.00 / $5.00
2026-10-26
HLE
Not sourced yet
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Not sourced yet
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
Kimi K3.1 Pro
Moonshot AI
$2.00 / $10.00
2026-10-23
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Terminal-Bench 4.0
67.2independentstd effort
OSWorld 2.0
$0.15 / $0.60
2026-10-19
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
25.8independentstd effort
OSWorld 2.0
61.7self-reportedAug set
Beam 1.0
Reflection
$0.70 / $2.10
2026-10-16
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
3.0independentstd effort
OSWorld 2.0
Not sourced yet
$0.23 / $0.57
2026-10-15
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
1.0self-reportedstd effort
OSWorld 2.0
Not sourced yet
Muse Spark Open
Meta (Meta Superintelligence Labs)
$1.25 / $4.25
2026-10-15
Terminal-Bench 2.1
DeepSWE
Not sourced yet
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
Muse Wonder
Meta (Meta Superintelligence Labs)
$4.00 / $20.00
2026-10-12
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Not sourced yet
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
OSWorld 2.0
$0.10 / $0.50
2026-10-07
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Not sourced yet
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
72.4self-reported2.1 offline
Mistral Large 4
Mistral AI
$0.70 / $2.10
2026-10-06
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
Gemini 4 Argon
Google DeepMind
$4.00 / $20.00
2026-09-30
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
69.2self-reportedAug offline
$2.00 / $10.00
2026-09-29
Terminal-Bench 2.1
Not sourced yet
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
71.4self-reportedAug offline
$2.00 / $10.00
2026-09-28
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
$0.43 / $0.87
2026-09-22
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Terminal-Bench 4.0
31.3independentstd effort
OSWorld 2.0
Not sourced yet
$0.14 / $0.28
2026-09-22
HLE
Not sourced yet
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
24.2independentstd effort
OSWorld 2.0
Not sourced yet
$4.00 / $20.00
2026-09-22
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
$0.10 / $0.50
2026-09-22
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
52.7self-reportedAug offline
Grok 4.7
xAI (SpaceXAI)
$2.00 / $6.00
2026-09-21
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
$1.00 / $2.70
2026-09-20
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Terminal-Bench 4.0
31.8independentstd effort
OSWorld 2.0
Not sourced yet
$0.30 / $1.20
2026-09-10
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
$10.00 / $50.00
2026-09-03
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
ARC-AGI-2
LiveBench
Not sourced yet
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
72.6self-reportedAug offline
Gemini 3.8 Flash
Google DeepMind
$0.75 / $3.75
2026-09-02
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
Muse Spark 1.3
Meta (Meta Superintelligence Labs)
$1.25 / $4.25
2026-09-02
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
66.9self-reportedAug set
$10.00 / $50.00
2026-09-01
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
Not sourced yet
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
$0.83 / $2.50
2026-08-28
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
Not sourced yet
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
8.1independentstd effort
OSWorld 2.0
Not sourced yet
GLM-5.3-Flash
Zhipu AI (Z.ai)
$0.15 / $0.50
2026-08-26
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
32.8independentstd effort
OSWorld 2.0
Not sourced yet
—
2026-08-26
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
Not sourced yet
OSWorld 2.0
Not sourced yet
GLM-5.3
Zhipu AI (Z.ai)
$1.40 / $4.40
2026-08-14
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
$1.32 / $3.96
2026-08-13
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
LiveBench
AnalystAgent
Not sourced yet
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
$2.00 / $6.00
2026-08-03
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
34.3independentstd effort
OSWorld 2.0
Not sourced yet
Kimi K3
Moonshot AI
$3.00 / $15.00
2026-07-16
Terminal-Bench 2.1
DeepSWE
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet
MiniMax M3
MiniMax
$0.30 / $1.20
2026-06-01
Terminal-Bench 2.1
DeepSWE
Not sourced yet
Toolathlon-Verified
Not sourced yet
Agents' Last Exam
Not sourced yet
ARC-AGI-2
Not sourced yet
LiveBench
AnalystAgent
Terminal-Bench 4.0
1.0independentstd effort
OSWorld 2.0
22.3independentJun set
Gemini 3.1 Pro Preview
Google DeepMind
$2.00 / $12.00
2026-02-19
Terminal-Bench 2.1
DeepSWE
Not sourced yet
Toolathlon-Verified
Agents' Last Exam
ARC-AGI-2
77.1independentuntiered
LiveBench
AnalystAgent
Terminal-Bench 4.0
OSWorld 2.0
Not sourced yet

INDEPENDENT = a third party ran the benchmark itself (tbench.ai, vals.ai, Artificial Analysis, Snorkel…).
SELF-REPORTED = the vendor’s own number, not yet replicated.
Every cell links to its source — methodology.

Showing 10 of 14 benchmarks. The other 4 are not ranked here because this site grades them unfit for ranking — 3 are saturated (too many models crowd the ceiling, so a gap between them is not a finding), and 1 is contaminated. All 14 benchmarks, with the grading.

Showing 32 of 44 models with sourced scores. 12 are previous versions of a line we track — a newer one in the same line and price tier shipped since — and are not ranked here for that reason: Claude Opus 4.8, GPT-5.6 Sol, GLM-5.2, Claude Fable 5, Claude Opus 5, Claude Sonnet 5, Grok 4.6, Gemini 3.7 Flash, DeepSeek V4 Flash (0731), Muse Spark 1.2, GPT-5.6 Luna, GPT-6 Sol. Every one of them keeps their own page, recorded price and scores — the full catalog has every model.

There is no total score. We won’t collapse 14 different benchmarks into one number that pretends a 0.5-point gap means something — see a head-to-head for which gaps here are real.

Analysis

All 4 analysis pieces and explainer →

Verdicts