RLTasksby ulam.ai
Models / OpenAI

OpenAI / MODEL EVIDENCE

GPT-4o (Aug 2024)

20 benchmarks · 20 observations · 16 sources · released 2024-08-06

Scores at a glance

20 benchmarks · large dot: GPT-4o (Aug 2024); small dots: closest models where reported

GPQA Diamond ↗49.21%
9.2896.4

GPT-4o (Aug 2024) · GPQA diamond · Best score (across scorers) · % ↗

MATH Level 5 ↗53.28%
3.2998.13

GPT-4o (Aug 2024) · MATH level 5 · Best score (across scorers) · % ↗

CadEval ↗26%
1274

GPT-4o (Aug 2024) · CadEval · Overall pass (%) · % ↗

MMLU ↗84.3%
29.587.3

GPT-4o (Aug 2024) · MMLU · EM · % ↗

LiveBench ↗55.33%
22.0882.35

GPT-4o (Aug 2024) · LiveBench · Global average · % ↗

Video-MME ↗71.9%
37.975

GPT-4o (Aug 2024) · VideoMME · Overall (no subtitles) · % ↗

HumanEval+ ↗87.2%
1.889

GPT 4o (Aug 2024) · HumanEval+ · Pass@1 · EvalPlus · official result data ↗

MBPP+ ↗72.2%
7.580.2

GPT 4o (Aug 2024) · MBPP+ · Pass@1 · EvalPlus · official result data ↗

HumanEval ↗92.7%
2.496.3

GPT 4o (Aug 2024) · HumanEval · Pass@1 · EvalPlus · official result data ↗

HealthBench Hard ↗0%
032

GPT-4o (Aug 2024) · HealthBench Hard · Weighted rubric score · original model comparison ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

7.6 percentile-point gap

6 of 7 shared benchmark comparisons

9.6 percentile-point gap

5 of 7 shared benchmark comparisons

12.0 percentile-point gap

6 of 7 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider LLM Leaderboards — Polyglot coding benchmark ↗

    Aider

  2. HealthBench: Evaluating Large Language Models Towards Improved Human Health — published result table ↗

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos et al. · 2025

    All 12 authors

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos, Sharman, Michael, Shah, Meghan, Vallone, Andrea, Beutel, Alex, Heidecke, Johannes, Singhal, Karan

  3. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

  4. Chess Puzzles ↗

    Epoch AI

  5. FrontierMath Tiers 1-3 (v1, old) ↗

    Epoch AI

  6. FrontierMath Tiers 1-3 (v2) ↗

    Epoch AI

  7. GPQA Diamond ↗

    Epoch AI

  8. MATH Level 5 ↗

    Epoch AI

  9. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  10. SimpleQA Verified ↗

    Epoch AI

  11. SimpleBench ↗

    Epoch AI

  12. AI benchmarks & capabilities ↗

    Epoch AI

  13. Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation — published result table ↗

    Liu, Jiawei, Xia, Chunqiu Steven, Wang, Yuyao, Zhang, Lingming · 2023

  14. LiveBench — model evaluation leaderboard ↗

    LiveBench Team

  15. Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis ↗

    Fu, Chaoyou, Dai, Yuhan, Luo, Yongdong, Li, Lei, Ren, Shuhuai, Zhang, Renrui et al. · 2024

    All 21 authors

    Fu, Chaoyou, Dai, Yuhan, Luo, Yongdong, Li, Lei, Ren, Shuhuai, Zhang, Renrui, Wang, Zihan, Zhou, Chenyu, Shen, Yunhang, Zhang, Mengdan, Chen, Peixian, Li, Yanwei, Lin, Shaohui, Zhao, Sirui, Li, Ke, Xu, Tong, Zheng, Xiawu, Chen, Enhong, Shan, Caifeng, He, Ran, Sun, Xing

  16. CadEval Dashboard — run 20250422_095709 ↗

    willpatrick · 2025

Names used in source tables

GPT 4o (Aug 2024) · GPT-4o (Aug 2024)