RLTasksby ulam.ai
Models / Qwen

Qwen / MODEL EVIDENCE

Qwen2 72B Instruct

5 benchmarks · 8 observations · 5 sources

Scores at a glance

5 benchmarks · large dot: Qwen2 72B Instruct; small dots: closest models where reported

ProcessBench ↗49.8 F1 points
5.187.9

Qwen2-72B-Instruct · ProcessBench · Average F1 · original comparison ↗

CFBench (Chinese Complex Following) ↗86.7%
60.990.8

Qwen2-72B-Instruct · CFBench (Chinese Complex Following) · Full set · Constraint satisfaction · full-set evaluation ↗

2 more reported results

58.9% · Qwen2-72B-Instruct · CFBench (Chinese Complex Following) · Full set · Instruction satisfaction · full-set evaluation · CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ↗

70.5% · Qwen2-72B-Instruct · CFBench (Chinese Complex Following) · Full set · Priority satisfaction · full-set evaluation · CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider refactoring benchmark ↗

    Paul Gauthier, Aider contributors

  2. BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions — published result table ↗

    Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari et al. · 2024

    All 33 authors

    Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, Binyuan Hui, Niklas Muennighoff, David Lo, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra

  3. CFBench: A Comprehensive Constraints-Following Benchmark for LLMs — published result table ↗

    Tao Zhang, Chenglin Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang et al. · 2024

    All 14 authors

    Tao Zhang, Chenglin Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, Zenan Zhou

  4. SysBench: Can Large Language Models Follow System Messages? — published result table ↗

    Yanzhao Qin, Tao Zhang, Tao Zhang, Yanjun Shen, Wenjing Luo, Haoze Sun et al. · 2024

    All 12 authors

    Yanzhao Qin, Tao Zhang, Tao Zhang, Yanjun Shen, Wenjing Luo, Haoze Sun, Yan Zhang, Yujing Qiao, Weipeng Chen, Zenan Zhou, Wentao Zhang, Bin Cui

  5. ProcessBench: Identifying Process Errors in Mathematical Reasoning — published result table ↗

    Zheng, Chujie, Zhang, Zhenru, Zhang, Beichen, Lin, Runji, Lu, Keming, Yu, Bowen et al. · 2024

    All 9 authors

    Zheng, Chujie, Zhang, Zhenru, Zhang, Beichen, Lin, Runji, Lu, Keming, Yu, Bowen, Liu, Dayiheng, Zhou, Jingren, Lin, Junyang

Names used in source tables

Qwen2 72B Instruct · Qwen2-72B-Instruct · Qwen2-Instruct / 72B