GPT-4o mini

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

1. Aider LLM Leaderboards — Polyglot coding benchmark ↗

   Aider

2. Aider refactoring benchmark ↗

   Paul Gauthier, Aider contributors

3. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone ↗

   Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach et al. · 2024

   All 129 authors

   Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Jianmin Bao, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Qin Cai, Vishrav Chaudhary, Dong Chen, Dongdong Chen, Weizhu Chen, Yen-Chun Chen, Yi-Ling Chen, Hao Cheng, Parul Chopra, Xiyang Dai, Matthew Dixon, Ronen Eldan, Victor Fragoso, Jianfeng Gao, Mei Gao, Min Gao, Amit Garg, Allie Del Giorno, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Wenxiang Hu, Jamie Huynh, Dan Iter, Sam Ade Jacobs, Mojan Javaheripi, Xin Jin, Nikos Karampatziakis, Piero Kauffmann, Mahoud Khademi, Dongwoo Kim, Young Jin Kim, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Yunsheng Li, Chen Liang, Lars Liden, Xihui Lin, Zeqi Lin, Ce Liu, Liyuan Liu, Mengchen Liu, Weishung Liu, Xiaodong Liu, Chong Luo, Piyush Madan, Ali Mahmoudzadeh, David Majercak, Matt Mazzola, Caio César Teodoro Mendes, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Liliang Ren, Gustavo de Rosa, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Yelong Shen, Swadheen Shukla, Xia Song, Masahiro Tanaka, Andrea Tupini, Praneetha Vaddamanu, Chunyu Wang, Guanhua Wang, Lijuan Wang, Shuohang Wang, Xin Wang, Yu Wang, Rachel Ward, Wen Wen, Philipp Witte, Haiping Wu, Xiaoxia Wu, Michael Wyatt, Bin Xiao, Can Xu, Jiahang Xu, Weijian Xu, Jilong Xue, Sonali Yadav, Fan Yang, Jianwei Yang, Yifan Yang, Ziyi Yang, Donghan Yu, Lu Yuan, Chenruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou

4. Phi-4 Technical Report ↗

   Marah Abdin, Jyoti Aneja, Harkirat Behl, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar et al. · 2024

   All 27 authors

   Marah Abdin, Jyoti Aneja, Harkirat Behl, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Michael Harrison, Russell J. Hewett, Mojan Javaheripi, Piero Kauffmann, James R. Lee, Yin Tat Lee, Yuanzhi Li, Weishung Liu, Caio C. T. Mendes, Anh Nguyen, Eric Price, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Xin Wang, Rachel Ward, Yue Wu, Dingli Yu, Cyril Zhang, Yi Zhang

5. LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs — published result table ↗

   Bai, Yushi, Zhang, Jiajie, Lv, Xin, Zheng, Linzhi, Zhu, Siqi, Hou, Lei et al. · 2024

   All 9 authors

   Bai, Yushi, Zhang, Jiajie, Lv, Xin, Zheng, Linzhi, Zhu, Siqi, Hou, Lei, Dong, Yuxiao, Tang, Jie, Li, Juanzi

6. Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale — published result table ↗

   Bonatti, Rogerio, Zhao, Dan, Bonacci, Francesco, Dupont, Dillon, Abdali, Sara, Li, Yinheng et al. · 2024

   All 12 authors

   Bonatti, Rogerio, Zhao, Dan, Bonacci, Francesco, Dupont, Dillon, Abdali, Sara, Li, Yinheng, Lu, Yadong, Wagle, Justin, Koishida, Kazuhito, Bucker, Arthur, Jang, Lawrence, Hui, Zack

7. CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark — published result table ↗

   Zachary S. Siegel, Sayash Kapoor, Nitya Nadgir, Benedikt Stroebl, Arvind Narayanan · 2024

8. HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly — published result table ↗

   Howard Yen, Tianyu Gao, Minmin Hou, Ke Ding, Daniel Fleischer, Peter Izsak et al. · 2024

   All 8 authors

   Howard Yen, Tianyu Gao, Minmin Hou, Ke Ding, Daniel Fleischer, Peter Izsak, Moshe Wasserblat, Danqi Chen

9. JudgeBench: A Benchmark for Evaluating LLM-based Judges — published result table ↗

   Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Y. Tang, Alejandro Cuadron, Chenguang Wang et al. · 2024

   All 8 authors

   Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Y. Tang, Alejandro Cuadron, Chenguang Wang, Raluca Ada Popa, Ion Stoica

10. HARP: A challenging human-annotated math reasoning benchmark — published result table ↗

    Yue, Albert S., Madaan, Lovish, Moskovitz, Ted, Strouse, DJ, Singh, Aaditya K. · 2024

11. The FACTS Grounding Leaderboard: Benchmarking LLMs' Ability to Ground Responses to Long-Form Input — published result table ↗

    Alon Jacovi, Andrew Wang, Chris Alberti, Connie Tao, Jon Lipovetz, Kate Olszewska et al. · 2025

    All 26 authors

    Alon Jacovi, Andrew Wang, Chris Alberti, Connie Tao, Jon Lipovetz, Kate Olszewska, Lukas Haas, Michelle Liu, Nate Keating, Adam Bloniarz, Carl Saroufim, Corey Fry, Dror Marcus, Doron Kukliansky, Gaurav Singh Tomar, James Swirhun, Jinwei Xing, Lily Wang, Madhu Gurumurthy, Michael Aaron, Moran Ambar, Rachana Fellinger, Rui Wang, Zizhao Zhang, Sasha Goldshtein, Dipanjan Das

12. MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents — published result table ↗

    Jiang, Yixing, Black, Kameron C., Geng, Gloria, Park, Danny, Zou, James, Ng, Andrew Y. et al. · 2025

    All 7 authors

    Jiang, Yixing, Black, Kameron C., Geng, Gloria, Park, Danny, Zou, James, Ng, Andrew Y., Chen, Jonathan H.

13. MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding — published result table ↗

    Yuxin Zuo, Shang Qu, Yifei Li, Zhangren Chen, Xuekai Zhu, Ermo Hua et al. · 2025

    All 9 authors

    Yuxin Zuo, Shang Qu, Yifei Li, Zhangren Chen, Xuekai Zhu, Ermo Hua, Kaiyan Zhang, Ning Ding, Bowen Zhou

14. ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning — published result table ↗

    Bill Yuchen Lin, Ronan Le Bras, Kyle Richardson, Ashish Sabharwal, Radha Poovendran, Peter Clark et al. · 2025

    All 7 authors

    Bill Yuchen Lin, Ronan Le Bras, Kyle Richardson, Ashish Sabharwal, Radha Poovendran, Peter Clark, Yejin Choi

15. BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ↗

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir et al. · 2024

    All 13 authors

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir, Pignatelli, Eduardo, Kuciński, Łukasz, Pinto, Lerrel, Fergus, Rob, Foerster, Jakob Nicolaus, Parker-Holder, Jack, Rocktäschel, Tim

16. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

17. LMCA — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

18. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

19. ARC-AGI-2 ↗

    Epoch AI

20. Chess Puzzles ↗

    Epoch AI

21. FrontierMath Tiers 1-3 (v2) ↗

    Epoch AI

22. GPQA Diamond ↗

    Epoch AI

23. MATH Level 5 ↗

    Epoch AI

24. Mystery Game Puzzles ↗

    Epoch AI

25. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

26. SimpleQA Verified ↗

    Epoch AI

27. SimpleBench ↗

    Epoch AI

28. Capabilities & benchmarking — retained external evaluation records ↗

    Epoch AI · 2026

29. AI benchmarks & capabilities ↗

    Epoch AI

30. GeoBench — GeoGuessr model benchmark ↗

    GeoBench

31. Writing benchmark — incorporating mandatory story elements ↗

    lechmazur

32. WeirdML ↗

    Håvard Tveit Ihle

33. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

34. LiveBench — model evaluation leaderboard ↗

    LiveBench Team

35. PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding — published result table ↗

    Chow, Wei, Mao, Jiageng, Li, Boyi, Seita, Daniel, Guizilini, Vitor, Wang, Yue · 2025

36. Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis ↗

    Fu, Chaoyou, Dai, Yuhan, Luo, Yongdong, Li, Lei, Ren, Shuhuai, Zhang, Renrui et al. · 2024

    All 21 authors

    Fu, Chaoyou, Dai, Yuhan, Luo, Yongdong, Li, Lei, Ren, Shuhuai, Zhang, Renrui, Wang, Zihan, Zhou, Chenyu, Shen, Yunhang, Zhang, Mengdan, Chen, Peixian, Li, Yanwei, Lin, Shaohui, Zhao, Sirui, Li, Ke, Xu, Tong, Zheng, Xiawu, Chen, Enhong, Shan, Caifeng, He, Ran, Sun, Xing

37. AIME — evaluation methodology and results ↗

    Vals AI · 2026

38. CorpFin — evaluation methodology and results ↗

    Vals AI · 2026

39. GPQA Diamond — evaluation methodology and results ↗

    Vals AI · 2026

40. LiveCodeBench — evaluation methodology and results ↗

    Vals AI · 2026

41. MATH 500 — evaluation methodology and results ↗

    Vals AI · 2026

42. MedQA — evaluation methodology and results ↗

    Vals AI · 2026

43. MGSM — evaluation methodology and results ↗

    Vals AI · 2026

44. MMLU Pro — evaluation methodology and results ↗

    Vals AI · 2026

45. MMMU Pro — evaluation methodology and results ↗

    Vals AI · 2026

46. MortgageTax — evaluation methodology and results ↗

    Vals AI · 2026

47. TaxEval — evaluation methodology and results ↗

    Vals AI · 2026