BALROG ↗12.8%
Qwen2-VL-72B-Instruct · Balrog · Average progress · % ↗
Qwen / MODEL EVIDENCE
Qwen2-VL-72B-Instruct
3 benchmarks · 3 observations · 3 sources · released 2024-08-29
Scores at a glance
3 benchmarks · large dot: Qwen2-VL-72B-Instruct; small dots: closest models where reported
Video-MME ↗71.2%
Qwen2-VL-72B-Instruct · VideoMME · Overall (no subtitles) · % ↗
VISTA ↗28.56%
Qwen2-VL-72B-Instruct · Scale Labs · Score ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ↗
All 13 authors
Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir, Pignatelli, Eduardo, Kuciński, Łukasz, Pinto, Lerrel, Fergus, Rob, Foerster, Jakob Nicolaus, Parker-Holder, Jack, Rocktäschel, Tim
- Scale Labs — evaluation methodology and results ↗
- Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis ↗
All 21 authors
Fu, Chaoyou, Dai, Yuhan, Luo, Yongdong, Li, Lei, Ren, Shuhuai, Zhang, Renrui, Wang, Zihan, Zhou, Chenyu, Shen, Yunhang, Zhang, Mengdan, Chen, Peixian, Li, Yanwei, Lin, Shaohui, Zhao, Sirui, Li, Ke, Xu, Tong, Zheng, Xiawu, Chen, Enhong, Shan, Caifeng, He, Ran, Sun, Xing
Names used in source tables
Qwen2-VL-72B-Instruct