RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

Vicuna 7B

7 benchmarks · 36 observations · 6 sources

Scores at a glance

7 benchmarks · large dot: Vicuna 7B; small dots: closest models where reported

FActScore ↗38.9%
17.373.1

Vicuna 7B · FActScore · estimator A · Unlabeled entity-biography evaluation ↗

BIPIA & InjecAgent (Indirect Prompt Injection) ↗12.37%
12.3731.03

Vicuna-7B · BIPIA & InjecAgent (Indirect Prompt Injection) · BIPIA overall attack success · black-box defense comparison ↗

2 more reported results

8.85% · Vicuna-7B · BIPIA & InjecAgent (Indirect Prompt Injection) · BIPIA overall attack success · black-box defense comparison · Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models ↗

6.17% · Vicuna-7B · BIPIA & InjecAgent (Indirect Prompt Injection) · BIPIA overall attack success · black-box defense comparison · Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models ↗

HumanEval+ ↗11.6%
1.889

Vicuna-7B · HumanEval+ · Pass@1 · EvalPlus · official result data ↗

HumanEval ↗11.6%
2.496.3

Vicuna-7B · HumanEval · Pass@1 · EvalPlus · official result data ↗

HaluEval 2.0 ↗52.51%
14.6660.91

Vicuna 7B · HaluEval 2.0 · Biomedicine · MaHR · published main comparison ↗

9 more reported results

18.79% · Vicuna 7B · HaluEval 2.0 · Biomedicine · MiHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

50.77% · Vicuna 7B · HaluEval 2.0 · Finance · MaHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

14.67% · Vicuna 7B · HaluEval 2.0 · Finance · MiHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

40.14% · Vicuna 7B · HaluEval 2.0 · Science · MaHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

10.42% · Vicuna 7B · HaluEval 2.0 · Science · MiHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

58.44% · Vicuna 7B · HaluEval 2.0 · Education · MaHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

19.12% · Vicuna 7B · HaluEval 2.0 · Education · MiHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

66.77% · Vicuna 7B · HaluEval 2.0 · Open Domain · MaHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

29.18% · Vicuna 7B · HaluEval 2.0 · Open Domain · MiHR · published main comparison · The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models ↗

ClinicBench ↗34.5%
28.483.4

Vicuna-7B · ClinicBench · MedQA · Accuracy · zero-shot main comparison ↗

16 more reported results

33.4% · Vicuna-7B · ClinicBench · MedMCQA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

43.4% · Vicuna-7B · ClinicBench · MMLU · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

64.8% · Vicuna-7B · ClinicBench · PubMedQA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

76.4% · Vicuna-7B · ClinicBench · Referral QA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

2.6 F1 points · Vicuna-7B · ClinicBench · Treat Recom. · F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

13.8 ROUGE-L points · Vicuna-7B · ClinicBench · MIMIC · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

8.2 ROUGE-L points · Vicuna-7B · ClinicBench · IU-Xray · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

4.5 ROUGE-L points · Vicuna-7B · ClinicBench · Hospitaliz. Summari. · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

3.1 ROUGE-L points · Vicuna-7B · ClinicBench · Patient Education · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

44.5 F1 entity-level points · Vicuna-7B · ClinicBench · BC5 · F1 entity-level · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

37 F1 entity-level points · Vicuna-7B · ClinicBench · NCBI · F1 entity-level · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

39.4 Micro F1 points · Vicuna-7B · ClinicBench · DDI · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

41.2 Micro F1 points · Vicuna-7B · ClinicBench · GAD · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

53.8 Micro F1 points · Vicuna-7B · ClinicBench · HoC · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

42.3% · Vicuna-7B · ClinicBench · Pharma. QA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

45.5% · Vicuna-7B · ClinicBench · Drug Inter. · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models — published result table ↗

    Jingwei Yi, Yueqi Xie, Bin Zhu, Emre Kiciman, Guangzhong Sun, Xing Xie et al. · 2023

    All 7 authors

    Jingwei Yi, Yueqi Xie, Bin Zhu, Emre Kiciman, Guangzhong Sun, Xing Xie, Fangzhao Wu

  2. The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models — published result table ↗

    Li, Junyi, Chen, Jie, Ren, Ruiyang, Cheng, Xiaoxue, Zhao, Wayne Xin, Nie, Jian-Yun et al. · 2024

    All 7 authors

    Li, Junyi, Chen, Jie, Ren, Ruiyang, Cheng, Xiaoxue, Zhao, Wayne Xin, Nie, Jian-Yun, Wen, Ji-Rong

  3. CriticBench: Benchmarking LLMs for Critique-Correct Reasoning — published result table ↗

    Zicheng Lin, Zhibin Gou, Tian Liang, Ruilin Luo, Haowei Liu, Yujiu Yang · 2024

  4. Large Language Models in the Clinic: A Comprehensive Benchmark — published result table ↗

    Liu, Fenglin, Li, Zheng, Zhou, Hongjian, Yin, Qingyu, Yang, Jingfeng, Tang, Xianfeng et al. · 2024

    All 19 authors

    Liu, Fenglin, Li, Zheng, Zhou, Hongjian, Yin, Qingyu, Yang, Jingfeng, Tang, Xianfeng, Luo, Chen, Zeng, Ming, Jiang, Haoming, Gao, Yifan, Nigam, Priyanka, Nag, Sreyashi, Yin, Bing, Hua, Yining, Zhou, Xuan, Rohanian, Omid, Thakur, Anshul, Clifton, Lei, Clifton, David A.

  5. Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation — published result table ↗

    Liu, Jiawei, Xia, Chunqiu Steven, Wang, Yuyao, Zhang, Lingming · 2023

  6. FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation — published result table ↗

    Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh et al. · 2023

    All 9 authors

    Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi

Names used in source tables

Vicuna 7B · Vicuna-7B · Vicuna-7b