Reported model / MODEL EVIDENCE

guanaco-65b / -

2 benchmarks · 2 observations · 2 sources

Scores at a glance

2 benchmarks · large dot: guanaco-65b / -; small dots: closest models where reported

15.295.3

guanaco-65b · AlpacaEval · AlpacaEval 1 · GPT-4 judged win rate · original leaderboard example ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. AgentBench: Evaluating LLMs as Agents — published result table ↗

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai et al. · 2023

    All 22 authors

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang

  2. AlpacaEval: An Automatic Evaluator of Instruction-following Models ↗

    Xuechen Li, Tianyi Zhang, Yann Dubois, Rohan Taori, Ishaan Gulrajani, Carlos Guestrin et al. · 2023

    All 8 authors

    Xuechen Li, Tianyi Zhang, Yann Dubois, Rohan Taori, Ishaan Gulrajani, Carlos Guestrin, Percy Liang, Tatsunori B. Hashimoto

Names used in source tables

guanaco-65b · guanaco-65b / -