GPT-5 (High) · CritPt v2 · code tools ↗
OpenAI / MODEL EVIDENCE
GPT-5
66 benchmarks · 136 observations · 76 sources · released 2025-08-07
Scores at a glance
66 benchmarks · large dot: GPT-5; small dots: closest models where reported
GPT 5 · MMLU Pro · Accuracy ↗
1 more reported result
87.07% · GPT-5 (High) · MMLU-Pro · AA implementation · Artificial Analysis ↗
GPT 5 · LiveCodeBench · Accuracy ↗
1 more reported result
84.55% · GPT-5 (High) · LiveCodeBench · AA implementation · Artificial Analysis ↗
GPT 5 · MATH 500 · Accuracy ↗
1 more reported result
99.40% · GPT-5 (High) · MATH-500 · Artificial Analysis ↗
GPT-5 (High) · AIME 2025 ↗
GPT-5 (High) · Global-MMLU-Lite ↗
GPT 5 · GPQA Diamond · Accuracy ↗
2 more reported results
86.17% · GPT-5 (high) · GPQA diamond · Best score (across scorers) · % · Epoch AI · GPQA diamond ↗
85.35% · GPT-5 (medium) · GPQA diamond · Best score (across scorers) · % · Epoch AI · GPQA diamond ↗
GPT-5 (high) · FrontierMath-2025-02-28-Private · Best score (across scorers) · % ↗
1 more reported result
27.24% · GPT-5 (medium) · FrontierMath-2025-02-28-Private · Best score (across scorers) · % · Epoch AI · FrontierMath-2025-02-28-Private ↗
GPT-5 (high) · FrontierMath-Tier-4-2025-07-01-Private · Best score (across scorers) · % ↗
1 more reported result
6.25% · GPT-5 (medium) · FrontierMath-Tier-4-2025-07-01-Private · Best score (across scorers) · % · Epoch AI · FrontierMath-Tier-4-2025-07-01-Private ↗
GPT-5 (high) · FrontierMath-Tiers-1-3-v2-Private · Best score (across scorers) · % ↗
1 more reported result
37.19% · GPT-5 (low) · FrontierMath-Tiers-1-3-v2-Private · Best score (across scorers) · % · Epoch AI · FrontierMath-Tiers-1-3-v2-Private ↗
GPT-5 (high) · FrontierMath-Tier-4-v2-Private · Best score (across scorers) · % ↗
GPT-5 (high) · MATH level 5 · Best score (across scorers) · % ↗
1 more reported result
97.92% · GPT-5 (medium) · MATH level 5 · Best score (across scorers) · % · Epoch AI · MATH level 5 ↗
GPT-5 (high) · OTIS Mock AIME 2024-2025 · Best score (across scorers) · % ↗
1 more reported result
87.22% · GPT-5 (medium) · OTIS Mock AIME 2024-2025 · Best score (across scorers) · % · Epoch AI · OTIS Mock AIME 2024-2025 ↗
GPT-5 (high) · SWE-Bench verified · Best score (across scorers) · % ↗
2 more reported results
71.49% · GPT-5 (medium) · SWE-Bench verified · Best score (across scorers) · % · Epoch AI · SWE-Bench verified ↗
69 % · GPT 5 (Mini-SWE-agent) · SWE-bench Verified · Score · Vals AI · SWE-bench Verified ↗
GPT-5 (high) · SimpleQA Verified · Best score (across scorers) · % ↗
GPT-5 (high) · Chess Puzzles · Best score (across scorers) · % ↗
2 more reported results
32% · GPT-5 (medium) · Chess Puzzles · Best score (across scorers) · % · Epoch AI · Chess Puzzles ↗
26% · GPT-5 (low) · Chess Puzzles · Best score (across scorers) · % · Epoch AI · Chess Puzzles ↗
GPT-5 (high) · EBR-bench · Best score (across scorers) · % ↗
GPT-5 (high) · Mystery Game Puzzles · Best score (across scorers) · % ↗
2 more reported results
16% · GPT-5 (low) · Mystery Game Puzzles · Best score (across scorers) · % · Epoch AI · Mystery Game Puzzles ↗
15% · GPT-5 (medium) · Mystery Game Puzzles · Best score (across scorers) · % · Epoch AI · Mystery Game Puzzles ↗
GPT-5 (high) · Aider coding benchmarks · Polyglot · percent correct ↗
5 more reported results
86.7% · GPT-5 (medium) · Aider coding benchmarks · Polyglot · percent correct · Epoch AI · Aider polyglot ↗
81.3% · GPT-5 (low) · Aider coding benchmarks · Polyglot · percent correct · Epoch AI · Aider polyglot ↗
88% · gpt-5 (high) · Aider coding benchmarks · Polyglot · percent correct · Aider code editing benchmark ↗
86.7% · gpt-5 (medium) · Aider coding benchmarks · Polyglot · percent correct · Aider code editing benchmark ↗
81.3% · gpt-5 (low) · Aider coding benchmarks · Polyglot · percent correct · Aider code editing benchmark ↗
GPT-5 (high) · ARC-AGI · Score · % ↗
2 more reported results
56.17% · GPT-5 (medium) · ARC-AGI · Score · % · Epoch AI · ARC-AGI ↗
44% · GPT-5 (low) · ARC-AGI · Score · % · Epoch AI · ARC-AGI ↗
GPT-5 (low) · DeepResearch Bench · Average score · % ↗
2 more reported results
48.6% · GPT-5 (medium) · DeepResearch Bench · Average score · % · Epoch AI · DeepResearch Bench ↗
48.1% · GPT-5 (high) · DeepResearch Bench · Average score · % · Epoch AI · DeepResearch Bench ↗
GPT-5 (medium) · Fiction.LiveBench · 16k token score · % ↗
GPT-5 (medium) · GeoBench · ACW Country % · % ↗
GPT-5 (high) · GSO-Bench · Score OPT@1 · % ↗
GPT-5 (medium) · Lech Mazur Writing · Mean rubric score / 10 ↗
GPT-5 (high) · SimpleBench · Score (AVG@5) · % ↗
GPT-5 (unknown thinking) · Terminal Bench · Accuracy mean · % ↗
7 more reported results
43.82% · GPT-5 (unknown thinking) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
35.17% · GPT-5 (unknown thinking) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
33.93% · GPT-5 (unknown thinking) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
49.6% · GPT-5 (medium) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
43.8% · GPT-5 (medium) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
35.2% · GPT-5 (medium) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
33.9% · GPT-5 (medium) · Terminal Bench · Accuracy mean · % · Epoch AI · Terminal Bench ↗
GPT-5 (high) · VPCT · Correct · % ↗
1 more reported result
63.2% · GPT-5 (medium) · VPCT · Correct · % · Epoch AI · VPCT ↗
GPT-5 (high) · WeirdML · Accuracy · % ↗
1 more reported result
39.77% · GPT-5 · WeirdML · Accuracy · % · Epoch AI · WeirdML ↗
GPT-5 (high) · ARC-AGI-2 · Score · % ↗
2 more reported results
7.49% · GPT-5 (medium) · ARC-AGI-2 · Score · % · Epoch AI · ARC-AGI-2 ↗
1.94% · GPT-5 (low) · ARC-AGI-2 · Score · % · Epoch AI · ARC-AGI-2 ↗
GPT-5 (high) · HLE · Accuracy · % ↗
1 more reported result
25.32% · GPT-5 (unknown thinking) · HLE · Accuracy · % · Epoch AI · HLE ↗
GPT-5 (high) · CritPt · Accuracy · % ↗
GPT-5 (unknown thinking) · Remote Labor Index · Score · % ↗
GPT-5 (medium) · GDPval · Win Rate (%) · % ↗
GPT-5 (medium) · METR task performance & time horizons · Average task accuracy ↗
3 more reported results
69.37% · GPT-5 (high) · METR task performance & time horizons · Average task accuracy · Epoch AI · METR Time Horizons ↗
203.01258 minutes · GPT-5 (high) · METR task performance & time horizons · 50% success task horizon · METR-Horizon-v1.1 · Epoch AI · METR Autonomy / Task-Horizon Suite · public result data ↗
137.31854 minutes · GPT-5 (medium) · METR task performance & time horizons · 50% success task horizon · Epoch AI · METR Autonomy / Task-Horizon Suite · public result data ↗
GPT-5 (high) · ProofBench · Accuracy · % ↗
GPT-5 (high) · LMCA · Score · % ↗
GPT-5 (high) · DTBench · Accuracy · % ↗
GPT-5 (unknown thinking) · SciCode · Score · % ↗
GPT-5 (medium) · WebDev Arena · Elo ↗
GPT-5 (unknown thinking) · EnigmaEval · Accuracy · % ↗
GPT-5 · General ECI · 26 October 2026 fit ↗
GPT 5 · LegalBench · Accuracy ↗
GPT 5 · CaseLaw · Accuracy ↗
GPT 5 · CorpFin · Accuracy ↗
GPT 5 · MortgageTax · Accuracy ↗
1 more reported result
73.39 % · GPT 5 · TaxEval · Accuracy · Vals AI · TaxEval ↗
GPT 5 · MedCode · Accuracy ↗
GPT 5 · MedScribe · Accuracy ↗
GPT 5 · MedQA · Accuracy ↗
GPT 5 · AIME · Accuracy ↗
GPT 5 · MGSM · Accuracy ↗
GPT 5 · MMMU Pro · Accuracy ↗
GPT 5 · SAGE · Accuracy ↗
GPT 5 (OpenHands) · Vibe Code Bench · original task set ↗
GPT 5 · Poker Agent · TrueSkill Rating ↗
gpt-5 · Scale Labs · Score ↗
gpt-5 · Scale Labs · Score ↗
GPT-5 (high) · TasteVal · Experimental compute multiplier · October 2026 paper comparison ↗
1 more reported result
0.53 × · GPT-5 (high) · TasteVal · Normalized final-performance multiplier · October 2026 paper comparison · TasteVal: Measuring the Experimental Research Taste of AI Systems Against Human Experts ↗
GPT-5 · CMT-Benchmark v1.0.0 · Overall pass@1 · expert condensed-matter problems ↗
GPT-5 · TextQuests · No clues · game progress · source 500-step protocol ↗
1 more reported result
70% · GPT-5 · TextQuests · With clues · game progress · source 500-step protocol · TextQuests: How Good are LLMs at Text-Based Video Games? ↗
GPT-5 (low) · GAIA-2 · Gaia2 full · Execution pass@1 · baseline ReAct · three runs ↗
15 more reported results
69.2% · GPT-5 (high) · GAIA-2 · Gaia2 full · Execution pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
64.2% · GPT-5 (low) · GAIA-2 · Gaia2 full · Search pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
79.6% · GPT-5 (high) · GAIA-2 · Gaia2 full · Search pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
39.6% · GPT-5 (low) · GAIA-2 · Gaia2 full · Ambiguity pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
51.9% · GPT-5 (high) · GAIA-2 · Gaia2 full · Ambiguity pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
30.2% · GPT-5 (low) · GAIA-2 · Gaia2 full · Adaptability pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
40.4% · GPT-5 (high) · GAIA-2 · Gaia2 full · Adaptability pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
2.3% · GPT-5 (low) · GAIA-2 · Gaia2 full · Time pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
0% · GPT-5 (high) · GAIA-2 · Gaia2 full · Time pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
28.3% · GPT-5 (low) · GAIA-2 · Gaia2 full · Noise pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
35.4% · GPT-5 (high) · GAIA-2 · Gaia2 full · Noise pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
24.6% · GPT-5 (low) · GAIA-2 · Gaia2 full · Agent2Agent pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
17.9% · GPT-5 (high) · GAIA-2 · Gaia2 full · Agent2Agent pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
34.6% · GPT-5 (low) · GAIA-2 · Gaia2 full · Overall pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
42.1% · GPT-5 (high) · GAIA-2 · Gaia2 full · Overall pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗
GPT-5 High · HMMT 2025 (Feb & Nov) · HMMT February 2025 · pass@1 · DeepSeek-V3.2 report ↗
1 more reported result
89.2% · GPT-5 High · HMMT 2025 (Feb & Nov) · HMMT November 2025 · pass@1 · DeepSeek-V3.2 report · DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models ↗
GPT-5 · Biomni-Eval · Biomni-Eval1 · mean task reward · Biomni-R0 · A1 scaffold and E1 environment ↗
10 more reported results
0 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · CRISPR delivery · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.62 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · catalog · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.74 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · OpenTargets · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.62 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · PharmaProjects · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.63 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · GWAS variant prioritization · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.54 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · LAB-Bench DbQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.72 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · LAB-Bench SeqQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.4 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · Patient gene detection · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.63 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · Rare disease diagnosis · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
0.56 / 1 · GPT-5 · Biomni-Eval · Biomni-Eval1 · Screen gene retrieval · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
gpt-5 · EconBench · EconBench prototype · risk-consistency error · published prototype observations ↗
GPT-5 (high) · Harmonic-mean speedup ↗
gpt-5 · Average contest performance ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
18 of 25 shared benchmark comparisons
17 of 25 shared benchmark comparisons
15 of 25 shared benchmark comparisons
How similarity is measured
Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Aider code editing benchmark ↗
- Aider LLM Leaderboards — Polyglot coding benchmark ↗
- ARC Prize - Leaderboard ↗
- Arena leaderboard — WebDev evaluation ↗
- AIME 2025 Benchmark | Artificial Analysis ↗
- CritPt v2 Benchmark | Artificial Analysis ↗
- Global-MMLU-Lite Benchmark | Artificial Analysis ↗
- LiveCodeBench Benchmark | Artificial Analysis ↗
- MATH-500 Benchmark | Artificial Analysis ↗
- MMLU-Pro Benchmark | Artificial Analysis ↗
- SciCode Benchmark | Artificial Analysis ↗
- TextQuests: How Good are LLMs at Text-Based Video Games? — published result table ↗
- CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers — published result table ↗
All 19 authors
Pan, Haining, Roggeveen, James V., Berg, Erez, Carrasquilla, Juan, Chowdhury, Debanjan, Ganguli, Surya, Ghimenti, Federico, Hasik, Juraj, Hunt, Henry, Jiang, Hong-Chen, Kamb, Mason, Kao, Ying-Jer, Khatami, Ehsan, Lawler, Michael J., Luo, Di, Neupert, Titus, Qi, Xiaoliang, Brenner, Michael P., Kim, Eun-Ah
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models — published result table ↗
All 264 authors
DeepSeek-AI, Liu, Aixin, Mei, Aoxue, Lin, Bangcai, Xue, Bing, Wang, Bingxuan, Xu, Bingzheng, Wu, Bochao, Zhang, Bowei, Lin, Chaofan, Dong, Chen, Lu, Chengda, Zhao, Chenggang, Deng, Chengqi, Xu, Chenhao, Ruan, Chong, Dai, Damai, Guo, Daya, Yang, Dejian, Chen, Deli, Li, Erhang, Zhou, Fangqi, Lin, Fangyun, Dai, Fucong, Hao, Guangbo, Chen, Guanting, Li, Guowei, Zhang, H., Xu, Hanwei, Li, Hao, Liang, Haofen, Wei, Haoran, Zhang, Haowei, Luo, Haowen, Ji, Haozhe, Ding, Honghui, Tang, Hongxuan, Cao, Huanqi, Gao, Huazuo, Qu, Hui, Zeng, Hui, Huang, Jialiang, Li, Jiashi, Xu, Jiaxin, Hu, Jiewen, Chen, Jingchang, Xiang, Jingting, Yuan, Jingyang, Cheng, Jingyuan, Zhu, Jinhua, Ran, Jun, Jiang, Junguang, Qiu, Junjie, Li, Junlong, Song, Junxiao, Dong, Kai, Gao, Kaige, Guan, Kang, Huang, Kexin, Zhou, Kexing, Huang, Kezhao, Yu, Kuai, Wang, Lean, Zhang, Lecong, Wang, Lei, Zhao, Liang, Yin, Liangsheng, Guo, Lihua, Luo, Lingxiao, Ma, Linwang, Wang, Litong, Zhang, Liyue, Di, M. S., Xu, M. Y, Zhang, Mingchuan, Zhang, Minghua, Tang, Minghui, Zhou, Mingxu, Huang, Panpan, Cong, Peixin, Wang, Peiyi, Wang, Qiancheng, Zhu, Qihao, Li, Qingyang, Chen, Qinyu, Du, Qiushi, Xu, Ruiling, Ge, Ruiqi, Zhang, Ruisong, Pan, Ruizhe, Wang, Runji, Yin, Runqiu, Xu, Runxin, Shen, Ruomeng, Zhang, Ruoyu, Liu, S. H., Lu, Shanghao, Zhou, Shangyan, Chen, Shanhuang, Cai, Shaofei, Chen, Shaoyuan, Hu, Shengding, Liu, Shengyu, Hu, Shiqiang, Ma, Shirong, Wang, Shiyu, Yu, Shuiping, Zhou, Shunfeng, Pan, Shuting, Zhou, Songyang, Ni, Tao, Yun, Tao, Pei, Tian, Ye, Tian, Yue, Tianyuan, Zeng, Wangding, Liu, Wen, Liang, Wenfeng, Pang, Wenjie, Luo, Wenjing, Gao, Wenjun, Zhang, Wentao, Gao, Xi, Wang, Xiangwen, Bi, Xiao, Liu, Xiaodong, Wang, Xiaohan, Chen, Xiaokang, Zhang, Xiaokang, Nie, Xiaotao, Cheng, Xin, Liu, Xin, Xie, Xin, Liu, Xingchao, Yu, Xingkai, Li, Xingyou, Yang, Xinyu, Li, Xinyuan, Chen, Xu, Su, Xuecheng, Pan, Xuehai, Lin, Xuheng, Fu, Xuwei, Wang, Y. Q., Zhang, Yang, Xu, Yanhong, Ma, Yanru, Li, Yao, Li, Yao, Zhao, Yao, Sun, Yaofeng, Wang, Yaohui, Qian, Yi, Yu, Yi, Zhang, Yichao, Ding, Yifan, Shi, Yifan, Xiong, Yiliang, He, Ying, Zhou, Ying, Zhong, Yinmin, Piao, Yishi, Wang, Yisong, Chen, Yixiao, Tan, Yixuan, Wei, Yixuan, Ma, Yiyang, Liu, Yiyuan, Yang, Yonglun, Guo, Yongqiang, Wu, Yongtong, Wu, Yu, Cheng, Yuan, Ou, Yuan, Xu, Yuanfan, Wang, Yuduan, Gong, Yue, Wu, Yuhan, Zou, Yuheng, Li, Yukun, Xiong, Yunfan, Luo, Yuxiang, You, Yuxiang, Liu, Yuxuan, Zhou, Yuyang, Wu, Z. F., Ren, Z. Z., Zhao, Zehua, Ren, Zehui, Sha, Zhangli, Fu, Zhe, Xu, Zhean, Xie, Zhenda, Zhang, Zhengyan, Hao, Zhewen, Gou, Zhibin, Ma, Zhicheng, Yan, Zhigang, Shao, Zhihong, Huang, Zhixian, Wu, Zhiyu, Li, Zhuoshu, Zhang, Zhuping, Xu, Zian, Wang, Zihao, Gu, Zihui, Zhu, Zijia, Li, Zilin, Zhang, Zipeng, Xie, Ziwei, Gao, Ziyi, Pan, Zizheng, Yao, Zongqing, Feng, Bei, Li, Hui, Cai, J. L., Ni, Jiaqi, Xu, Lei, Li, Meng, Tian, Ning, Chen, R. J., Jin, R. L., Li, S. S., Zhou, Shuang, Sun, Tianyu, Li, X. Q., Jin, Xiangyue, Shen, Xiaojin, Chen, Xiaosha, Song, Xinnan, Zhou, Xinyi, Zhu, Y. X., Huang, Yanping, Li, Yaohui, Zheng, Yi, Zhu, Yuchen, Ma, Yunxian, Huang, Zhen, Xu, Zhipeng, Zhang, Zhongyu, Ji, Dongjie, Liang, Jian, Guo, Jianzhong, Chen, Jin, Xia, Leyi, Wang, Miaojun, Li, Mingming, Zhang, Peng, Chen, Ruyi, Sun, Shangmian, Wu, Shaoqing, Ye, Shengfeng, Wang, T., Xiao, W. L., An, Wei, Wang, Xianzu, Sun, Xiaowen, Wang, Xiaoxiang, Tang, Ying, Zha, Yukun, Zhang, Zekai, Ju, Zhe, Zhang, Zhen, Qu, Zihua
- Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments — published result table ↗
All 24 authors
Froger, Romain, Andrews, Pierre, Bettini, Matteo, Budhiraja, Amar, Cabral, Ricardo Silveira, Do, Virginie, Garreau, Emilien, Gaya, Jean-Baptiste, Laurençon, Hugo, Lecanu, Maxime, Malkan, Kunal, Mekala, Dheeraj, Ménard, Pierre, Bertran, Gerard Moreno-Torres, Piterbarg, Ulyana, Plekhanov, Mikhail, Rita, Mathieu, Rusakov, Andrey, Vorotilov, Vladislav, Wang, Mengjue, Yu, Ian, Benhalloum, Amine, Mialon, Grégoire, Scialom, Thomas
- TasteVal: Measuring the Experimental Research Taste of AI Systems Against Human Experts — published result table ↗
- DTBench — Conceptual Reasoning Index ↗
- LMCA — Conceptual Reasoning Index ↗
- FutureSearch Evals ↗
- EconBench: Economic choice by language models — gpt-5 prototype metrics ↗
- Ale Bench — methodology and published results ↗
- Algotune — methodology and published results ↗
- ARC-AGI-2 ↗
- Chess Puzzles ↗
- CritPt v1 ↗
- Earthborne Rangers (EBR-bench) ↗
- FrontierMath Tier 4 (v1, old) ↗
- FrontierMath Tier 4 (v2) ↗
- FrontierMath Tiers 1-3 (v1, old) ↗
- FrontierMath Tiers 1-3 (v2) ↗
- GDPval ↗
- GPQA Diamond ↗
- Humanity's Last Exam ↗
- MATH Level 5 ↗
- METR Time Horizons ↗
- Mystery Game Puzzles ↗
- OTIS Mock AIME 2024-2025 ↗
- Remote Labor Index ↗
- SimpleQA Verified ↗
- SWE-bench Verified ↗
- Terminal-Bench 2.0 ↗
- Capabilities & benchmarking — retained external evaluation records ↗
- AI benchmarks & capabilities ↗
- Fiction.liveBench — March 14, 2025 benchmark release ↗
- GeoBench — GeoGuessr model benchmark ↗
- Writing benchmark — incorporating mandatory story elements ↗
- GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents ↗
- WeirdML ↗
- Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗
- EnigmaEval ↗
- Scale Labs — evaluation methodology and results ↗
- Scale Labs — evaluation methodology and results ↗
- AI Model Benchmarks — LM Council ↗
- Measuring AI Ability to Complete Long Software Tasks ↗
- Metr Autonomy Task Horizon Suite — methodology and published results ↗
- Terminal-Bench 2.0 leaderboard ↗
- AIME — evaluation methodology and results ↗
- CaseLaw — evaluation methodology and results ↗
- CorpFin — evaluation methodology and results ↗
- GPQA Diamond — evaluation methodology and results ↗
- LiveCodeBench — evaluation methodology and results ↗
- LegalBench — evaluation methodology and results ↗
- MATH 500 — evaluation methodology and results ↗
- MedCode — evaluation methodology and results ↗
- MedQA — evaluation methodology and results ↗
- MedScribe — evaluation methodology and results ↗
- MGSM — evaluation methodology and results ↗
- MMLU Pro — evaluation methodology and results ↗
- MMMU Pro — evaluation methodology and results ↗
- MortgageTax — evaluation methodology and results ↗
- Poker Agent — evaluation methodology and results ↗
- ProofBench — evaluation methodology and results ↗
- SAGE — evaluation methodology and results ↗
- SWE-bench Verified — evaluation methodology and results ↗
- TaxEval — evaluation methodology and results ↗
- Vibe Code Bench — evaluation methodology and results ↗
Names used in source tables
GPT 5 · GPT 5 (Mini-SWE-agent) · GPT 5 (OpenHands) · GPT-5 · GPT-5 (High) · GPT-5 (high) · GPT-5 (low) · GPT-5 (medium) · GPT-5 (unknown thinking) · GPT-5 High · gpt-5 · gpt-5 (high) · gpt-5 (low) · gpt-5 (medium)