RLTasksby ulam.ai
Models / xAI

xAI / MODEL EVIDENCE

Grok 3

27 benchmarks · 29 observations · 27 sources · released 2025-04-09

Scores at a glance

27 benchmarks · large dot: Grok 3; small dots: closest models where reported

BALROG ↗29.5%
3.768.3

Grok 3 · Balrog · Average progress · % ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

11.6 percentile-point gap

14 of 14 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider LLM Leaderboards — Polyglot coding benchmark ↗

    Aider

  2. ARC Prize - Leaderboard ↗

    ARC Prize Foundation

  3. HealthBench: Evaluating Large Language Models Towards Improved Human Health — published result table ↗

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos et al. · 2025

    All 12 authors

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos, Sharman, Michael, Shah, Meghan, Vallone, Andrea, Beutel, Alex, Heidecke, Johannes, Singhal, Karan

  4. SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models — published result table ↗

    Pham, Thinh, Nguyen, Nguyen, Zunjare, Pratibha, Chen, Weiyuan, Tseng, Yu-Min, Vu, Tu · 2025

  5. TextQuests: How Good are LLMs at Text-Based Video Games? — published result table ↗

    Phan, Long, Mazeika, Mantas, Zou, Andy, Hendrycks, Dan · 2025

  6. BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ↗

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir et al. · 2024

    All 13 authors

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir, Pignatelli, Eduardo, Kuciński, Łukasz, Pinto, Lerrel, Fergus, Rob, Foerster, Jakob Nicolaus, Parker-Holder, Jack, Rocktäschel, Tim

  7. ARC-AGI-2 ↗

    Epoch AI

  8. FrontierMath Tier 4 (v1, old) ↗

    Epoch AI

  9. FrontierMath Tiers 1-3 (v1, old) ↗

    Epoch AI

  10. GPQA Diamond ↗

    Epoch AI

  11. MATH Level 5 ↗

    Epoch AI

  12. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  13. SimpleBench ↗

    Epoch AI

  14. AI benchmarks & capabilities ↗

    Epoch AI

  15. Fiction.liveBench — March 14, 2025 benchmark release ↗

    Fiction.live · 2025

  16. Writing benchmark — incorporating mandatory story elements ↗

    lechmazur

  17. WeirdML ↗

    Håvard Tveit Ihle

  18. AIME — evaluation methodology and results ↗

    Vals AI · 2026

  19. CorpFin — evaluation methodology and results ↗

    Vals AI · 2026

  20. GPQA Diamond — evaluation methodology and results ↗

    Vals AI · 2026

  21. LiveCodeBench — evaluation methodology and results ↗

    Vals AI · 2026

  22. LegalBench — evaluation methodology and results ↗

    Vals AI · 2026

  23. MATH 500 — evaluation methodology and results ↗

    Vals AI · 2026

  24. MedQA — evaluation methodology and results ↗

    Vals AI · 2026

  25. MGSM — evaluation methodology and results ↗

    Vals AI · 2026

  26. MMLU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  27. TaxEval — evaluation methodology and results ↗

    Vals AI · 2026

Names used in source tables

Grok 3