Vals Index ↗43.66 %
Mercury 3 · Vals Index · Accuracy ↗
Reported model / MODEL EVIDENCE
Mercury 3
11 benchmarks · 11 observations · 11 sources
Scores at a glance
11 benchmarks · large dot: Mercury 3; small dots: closest models where reported
Vals Finance Index ↗47.22 %
Mercury 3 · Vals Finance Index · Accuracy ↗
Vals Legal Index ↗62.96 %
Mercury 3 · Vals Legal Index · Accuracy ↗
Legal Research Bench ↗28.85 %
Mercury 3 · Legal Research Bench · All-Pass ↗
Mercury 3 · HLAB-Vals-1.1 · Task Pass Rate ↗
Vals Finance Agent v2.1 ↗54.71 %
Mercury 3 · Finance Agent · Accuracy ↗
Mercury 3 · Excel Modeling Benchmark · Accuracy ↗
Tax Agent Bench ↗18.17 %
Mercury 3 · Tax Agent Bench · Accuracy ↗
Vibe Code Bench ↗60.93 %
Mercury 3 (OpenHands) · Vibe Code Bench · original task set ↗
Code Migration v1.1 ↗39.26 %
Mercury 3 · Code Migration · Accuracy ↗
Terminal-Bench 4.0 ↗3.03 %
Mercury 3 (Mini-SWE-agent) · Terminal-Bench 4.0 · Score ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
9 of 11 shared benchmark comparisons
9 of 11 shared benchmark comparisons
9 of 11 shared benchmark comparisons
How similarity is measured
Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Code Migration — evaluation methodology and results ↗
- Excel Modeling Benchmark — evaluation methodology and results ↗
- Finance Agent — evaluation methodology and results ↗
- Vals Finance Index — evaluation methodology and results ↗
- HLAB-Vals-1.1 — evaluation methodology and results ↗
- Vals Legal Index — evaluation methodology and results ↗
- Legal Research Bench — evaluation methodology and results ↗
- Tax Agent Bench — evaluation methodology and results ↗
- Terminal-Bench 4.0 — evaluation methodology and results ↗
- Vals Index — evaluation methodology and results ↗
- Vibe Code Bench — evaluation methodology and results ↗
Names used in source tables
Mercury 3 · Mercury 3 (Mini-SWE-agent) · Mercury 3 (OpenHands)