qwen1.5-110b-chat · Aider coding benchmarks · Refactoring · percent correct ↗
Qwen / MODEL EVIDENCE
qwen1.5-110b-chat
3 benchmarks · 5 observations · 3 sources
Scores at a glance
3 benchmarks · large dot: qwen1.5-110b-chat; small dots: closest models where reported
Qwen1.5-110B-Chat · CFBench (Chinese Complex Following) · Full set · Constraint satisfaction · full-set evaluation ↗
2 more reported results
50% · Qwen1.5-110B-Chat · CFBench (Chinese Complex Following) · Full set · Instruction satisfaction · full-set evaluation · CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ↗
61.5% · Qwen1.5-110B-Chat · CFBench (Chinese Complex Following) · Full set · Priority satisfaction · full-set evaluation · CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ↗
ForecastBench ↗59.5 Brier index
qwen1.5-110b-chat† · Overall difficulty-adjusted Brier index ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Aider refactoring benchmark ↗
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs — published result table ↗
All 14 authors
Tao Zhang, Chenglin Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, Zenan Zhou
- Forecastbench — methodology and published results ↗
Names used in source tables
Qwen1.5-110B-Chat · qwen1.5-110b-chat · qwen1.5-110b-chat†