gemini-2-0-flash · Scale Labs · large ↗
Google / MODEL EVIDENCE
gemini-2-0-flash
10 benchmarks · 11 observations · 10 sources
Scores at a glance
10 benchmarks · large dot: gemini-2-0-flash; small dots: closest models where reported
Gemini 2.0 Flash · Scale Labs · Score ↗
Gemini-2.0-Flash · BrowseComp-ZH · Answer accuracy · original comparison ↗
Gemini-2.0-flash · SuperGPQA · Sample-weighted accuracy · reasoning, chat and base-model cohorts ↗
Gemini-2.0-Flash · MedXpertQA (Text & MM) · Multimodal-model text subset ↗
1 more reported result
37.2% · Gemini-2.0-Flash · MedXpertQA (Text & MM) · Multimodal subset · MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding ↗
gemini-2.0-flash · PaperBench · Average replication score · BasicAgent ↗
Gemini 2.0 Flash · BIG-Bench Extra Hard (BBEH) · Overall accuracy · original model comparison ↗
Gemini 2.0 Flash · MedAgentBench · Overall task success · original evaluation ↗
Gemini 2.0 Flash · CMT-Benchmark v1.0.0 · Overall pass@1 · expert condensed-matter problems ↗
gemini-2.0-flash · EconBench · EconBench prototype · risk-consistency error · published prototype observations ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
6 of 9 shared benchmark comparisons
How similarity is measured
Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents — published result table ↗
All 7 authors
Jiang, Yixing, Black, Kameron C., Geng, Gloria, Park, Danny, Zou, James, Ng, Andrew Y., Chen, Jonathan H.
- MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding — published result table ↗
All 9 authors
Yuxin Zuo, Shang Qu, Yifei Li, Zhangren Chen, Xuekai Zhu, Ermo Hua, Kaiyan Zhang, Ning Ding, Bowen Zhou
- BIG-Bench Extra Hard — published result table ↗
All 20 authors
Kazemi, Mehran, Fatemi, Bahare, Bansal, Hritik, Palowitch, John, Anastasiou, Chrysovalantis, Mehta, Sanket Vaibhav, Jain, Lalit K., Aglietti, Virginia, Jindal, Disha, Chen, Peter, Dikkala, Nishanth, Tyen, Gladys, Liu, Xin, Shalit, Uri, Chiappa, Silvia, Olszewska, Kate, Tay, Yi, Tran, Vinh Q., Le, Quoc V., Firat, Orhan
- PaperBench: Evaluating AI's Ability to Replicate AI Research — published result table ↗
All 13 authors
Giulio Starace, Oliver Jaffe, Dane Sherburn, James Aung, Jun Shern Chan, Leon Maksin, Rachel Dias, Evan Mays, Benjamin Kinsella, Wyatt Thompson, Johannes Heidecke, Amelia Glaese, Tejal Patwardhan
- CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers — published result table ↗
All 19 authors
Pan, Haining, Roggeveen, James V., Berg, Erez, Carrasquilla, Juan, Chowdhury, Debanjan, Ganguli, Surya, Ghimenti, Federico, Hasik, Juraj, Hunt, Henry, Jiang, Hong-Chen, Kamb, Mason, Kao, Ying-Jer, Khatami, Ehsan, Lawler, Michael J., Luo, Di, Neupert, Titus, Qi, Xiaoliang, Brenner, Michael P., Kim, Eun-Ah
- EconBench: Economic choice by language models — gemini-2.0-flash prototype metrics ↗
- Scale Labs — evaluation methodology and results ↗
- Scale Labs — evaluation methodology and results ↗
- BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinese — published result table ↗
All 16 authors
Peilin Zhou, Bruce Leon, Xiang Ying, Can Zhang, Yifan Shao, Qichen Ye, Dading Chong, Zhiling Jin, Chenxuan Xie, Meng Cao, Yuxin Gu, Sixin Hong, Jing Ren, Jian Chen, Chao Liu, Yining Hua
- SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines — published result table ↗
All 97 authors
M-A-P Team, Xinrun Du, Yifan Yao, Kaijing Ma, Bingli Wang, Tianyu Zheng, King Zhu, Minghao Liu, Yiming Liang, Xiaolong Jin, Zhenlin Wei, Chujie Zheng, Kaixin Deng, Shawn Gavin, Shian Jia, Sichao Jiang, Yiyan Liao, Rui Li, Qinrui Li, Sirun Li, Yizhi Li, Yunwen Li, David Ma, Yuansheng Ni, Haoran Que, Qiyao Wang, Zhoufutu Wen, Siwei Wu, Tyshawn Hsing, Ming Xu, Zhenzhu Yang, Zekun Moore Wang, Junting Zhou, Yuelin Bai, Xingyuan Bu, Chenglin Cai, Liang Chen, Yifan Chen, Chengtuo Cheng, Tianhao Cheng, Keyi Ding, Siming Huang, Yun Huang, Yaoru Li, Yizhe Li, Zhaoqun Li, Tianhao Liang, Chengdong Lin, Hongquan Lin, Yinghao Ma, Tianyang Pang, Zhongyuan Peng, Zifan Peng, Qige Qi, Shi Qiu, Xingwei Qu, Shanghaoran Quan, Yizhou Tan, Zili Wang, Chenqing Wang, Hao Wang, Yiya Wang, Yubo Wang, Jiajun Xu, Kexin Yang, Ruibin Yuan, Yuanhao Yue, Tianyang Zhan, Chun Zhang, Jinyang Zhang, Xiyue Zhang, Xingjian Zhang, Yue Zhang, Yongchi Zhao, Xiangyu Zheng, Chenghua Zhong, Yang Gao, Zhoujun Li, Dayiheng Liu, Qian Liu, Tianyu Liu, Shiwen Ni, Junran Peng, Yujia Qin, Wenbo Su, Guoyin Wang, Shi Wang, Jian Yang, Min Yang, Meng Cao, Xiang Yue, Zhaoxiang Zhang, Wangchunshu Zhou, Jiaheng Liu, Qunshu Lin, Wenhao Huang, Ge Zhang
Names used in source tables
Gemini 2.0 Flash · Gemini-2.0-Flash · Gemini-2.0-flash · gemini-2-0-flash · gemini-2.0-flash