Meta / MODEL EVIDENCE

Llama 2-7B

23 benchmarks · 97 observations · 25 sources · released 2023-07-18

Scores at a glance

23 benchmarks · large dot: Llama 2-7B; small dots: closest models where reported

44.569.2

Llama 2-7B · ARC AI2 · Challenge score · % ↗

5 more reported results

45.9% · Llama 2-7B · ARC AI2 · Challenge score · % · Epoch AI · ARC AI2 ↗

45.9% · Llama 2-7B · ARC AI2 · Challenge score · % · Epoch AI · ARC AI2 ↗

43.2% · Llama 2-7B · ARC AI2 · Challenge score · % · Epoch AI · ARC AI2 ↗

45.9% · Llama 2-7B · ARC AI2 · Challenge score · % · Epoch AI · ARC AI2 ↗

43.4% · Llama 2-7B · ARC AI2 · Challenge score · % · Epoch AI · ARC AI2 ↗

1.224.4

LLaMA-2 7B · CollegeMath · CollegeMath accuracy · MathScale paper · MwpBench evaluation ↗

CMMLU ↗32.96%
31.2470.95

LLaMA2-7B* · CMMLU · Five-shot subject-macro accuracy · original five-shot comparison ↗

BizBench ↗48.2 points
2884.6

Llama 2 / 7B · BizBench · Published task average · zero-shot and few-shot evaluation ↗

1.0340.99

LLaMA-2-7B · SciBench · Textbook overall accuracy · prompting and tool conditions ↗

3 more reported results

0.67% · LLaMA-2-7B · SciBench · Textbook overall accuracy · prompting and tool conditions · SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models ↗

3.6% · LLaMA-2-7B · SciBench · Textbook overall accuracy · prompting and tool conditions · SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models ↗

1.2% · LLaMA-2-7B · SciBench · Textbook overall accuracy · prompting and tool conditions · SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models ↗

7.641.3

Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Incomplete · compliance rate · reported model comparison ↗

11 more reported results

52.9% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Unsupported · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

7.8% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Indeterminate · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

7.1% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Safety · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

22% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Humanizing · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

73.6% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · No system prompt · Contrast set · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

14.2% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Incomplete · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

40.1% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Unsupported · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

12% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Indeterminate · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

6.6% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Safety · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

42.7% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Humanizing · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

63.9% · Llama-2-7b · CoCoNot (Contextual Non-Compliance) · With system prompt · Contrast set · compliance rate · reported model comparison · The Art of Saying No: Contextual Noncompliance in Language Models ↗

28.483.4

LLaMA-2-7B · ClinicBench · MedQA · Accuracy · zero-shot main comparison ↗

16 more reported results

30.6% · LLaMA-2-7B · ClinicBench · MedMCQA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

42.3% · LLaMA-2-7B · ClinicBench · MMLU · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

63.4% · LLaMA-2-7B · ClinicBench · PubMedQA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

74.5% · LLaMA-2-7B · ClinicBench · Referral QA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

3.3 F1 points · LLaMA-2-7B · ClinicBench · Treat Recom. · F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

12.3 ROUGE-L points · LLaMA-2-7B · ClinicBench · MIMIC · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

8.6 ROUGE-L points · LLaMA-2-7B · ClinicBench · IU-Xray · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

4.9 ROUGE-L points · LLaMA-2-7B · ClinicBench · Hospitaliz. Summari. · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

4.6 ROUGE-L points · LLaMA-2-7B · ClinicBench · Patient Education · ROUGE-L · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

40.1 F1 entity-level points · LLaMA-2-7B · ClinicBench · BC5 · F1 entity-level · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

34.8 F1 entity-level points · LLaMA-2-7B · ClinicBench · NCBI · F1 entity-level · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

37.9 Micro F1 points · LLaMA-2-7B · ClinicBench · DDI · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

39.3 Micro F1 points · LLaMA-2-7B · ClinicBench · GAD · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

48.6 Micro F1 points · LLaMA-2-7B · ClinicBench · HoC · Micro F1 · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

46.5% · LLaMA-2-7B · ClinicBench · Pharma. QA · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

48% · LLaMA-2-7B · ClinicBench · Drug Inter. · Accuracy · zero-shot main comparison · Large Language Models in the Clinic: A Comprehensive Benchmark ↗

16.960.1

LLaMA-2-7b · CRAFT-MD · Free response · Vignette accuracy · combined dataset ↗

7 more reported results

6.6% · LLaMA-2-7b · CRAFT-MD · Free response · Multi-turn conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

6.5% · LLaMA-2-7b · CRAFT-MD · Free response · Single-turn conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

8.1% · LLaMA-2-7b · CRAFT-MD · Free response · Summarized conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

39.5% · LLaMA-2-7b · CRAFT-MD · Four-choice MCQ · Vignette accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

31.9% · LLaMA-2-7b · CRAFT-MD · Four-choice MCQ · Multi-turn conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

30.4% · LLaMA-2-7b · CRAFT-MD · Four-choice MCQ · Single-turn conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

33.5% · LLaMA-2-7b · CRAFT-MD · Four-choice MCQ · Summarized conversation accuracy · combined dataset · An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Llama 2: Open Foundation and Fine-Tuned Chat Models ↗

    Touvron, Hugo, Martin, Louis, Stone, Kevin, Albert, Peter, Almahairi, Amjad, Babaei, Yasmine et al. · 2023

    All 68 authors

    Touvron, Hugo, Martin, Louis, Stone, Kevin, Albert, Peter, Almahairi, Amjad, Babaei, Yasmine, Bashlykov, Nikolay, Batra, Soumya, Bhargava, Prajjwal, Bhosale, Shruti, Bikel, Dan, Blecher, Lukas, Ferrer, Cristian Canton, Chen, Moya, Cucurull, Guillem, Esiobu, David, Fernandes, Jude, Fu, Jeremy, Fu, Wenyin, Fuller, Brian, Gao, Cynthia, Goswami, Vedanuj, Goyal, Naman, Hartshorn, Anthony, Hosseini, Saghar, Hou, Rui, Inan, Hakan, Kardas, Marcin, Kerkez, Viktor, Khabsa, Madian, Kloumann, Isabel, Korenev, Artem, Koura, Punit Singh, Lachaux, Marie-Anne, Lavril, Thibaut, Lee, Jenya, Liskovich, Diana, Lu, Yinghai, Mao, Yuning, Martinet, Xavier, Mihaylov, Todor, Mishra, Pushkar, Molybog, Igor, Nie, Yixin, Poulton, Andrew, Reizenstein, Jeremy, Rungta, Rashi, Saladi, Kalyan, Schelten, Alan, Silva, Ruan, Smith, Eric Michael, Subramanian, Ranjan, Tan, Xiaoqing Ellen, Tang, Binh, Taylor, Ross, Williams, Adina, Kuan, Jian Xiang, Xu, Puxin, Yan, Zheng, Zarov, Iliyan, Zhang, Yuchen, Fan, Angela, Kambadur, Melanie, Narang, Sharan, Rodriguez, Aurelien, Stojnic, Robert, Edunov, Sergey, Scialom, Thomas

  2. Textbooks Are All You Need II: phi-1.5 technical report ↗

    Li, Yuanzhi, Bubeck, Sébastien, Eldan, Ronen, Del Giorno, Allie, Gunasekar, Suriya, Lee, Yin Tat · 2023

  3. Baichuan 2: Open Large-scale Language Models ↗

    Yang, Aiyuan, Xiao, Bin, Wang, Bingning, Zhang, Borong, Bian, Ce, Yin, Chao et al. · 2023

    All 55 authors

    Yang, Aiyuan, Xiao, Bin, Wang, Bingning, Zhang, Borong, Bian, Ce, Yin, Chao, Lv, Chenxu, Pan, Da, Wang, Dian, Yan, Dong, Yang, Fan, Deng, Fei, Wang, Feng, Liu, Feng, Ai, Guangwei, Dong, Guosheng, Zhao, Haizhou, Xu, Hang, Sun, Haoze, Zhang, Hongda, Liu, Hui, Ji, Jiaming, Xie, Jian, Dai, JunTao, Fang, Kun, Su, Lei, Song, Liang, Liu, Lifeng, Ru, Liyun, Ma, Luyao, Wang, Mang, Liu, Mickel, Lin, MingAn, Nie, Nuolan, Guo, Peidong, Sun, Ruiyang, Zhang, Tao, Li, Tianpeng, Li, Tianyu, Cheng, Wei, Chen, Weipeng, Zeng, Xiangrong, Wang, Xiaochuan, Chen, Xiaoxi, Men, Xin, Yu, Xin, Pan, Xuehai, Shen, Yanjun, Wang, Yiding, Li, Yiyu, Jiang, Youxin, Gao, Yuchen, Zhang, Yupeng, Zhou, Zenan, Wu, Zhiying

  4. Qwen Technical Report ↗

    Bai, Jinze, Bai, Shuai, Chu, Yunfei, Cui, Zeyu, Dang, Kai, Deng, Xiaodong et al. · 2023

    All 48 authors

    Bai, Jinze, Bai, Shuai, Chu, Yunfei, Cui, Zeyu, Dang, Kai, Deng, Xiaodong, Fan, Yang, Ge, Wenbin, Han, Yu, Huang, Fei, Hui, Binyuan, Ji, Luo, Li, Mei, Lin, Junyang, Lin, Runji, Liu, Dayiheng, Liu, Gao, Lu, Chengqiang, Lu, Keming, Ma, Jianxin, Men, Rui, Ren, Xingzhang, Ren, Xuancheng, Tan, Chuanqi, Tan, Sinan, Tu, Jianhong, Wang, Peng, Wang, Shijie, Wang, Wei, Wu, Shengguang, Xu, Benfeng, Xu, Jin, Yang, An, Yang, Hao, Yang, Jian, Yang, Shusheng, Yao, Yang, Yu, Bowen, Yuan, Hongyi, Yuan, Zheng, Zhang, Jianwei, Zhang, Xingxuan, Zhang, Yichang, Zhang, Zhenru, Zhou, Chang, Zhou, Jingren, Zhou, Xiaohuan, Zhu, Tianhang

  5. The Falcon Series of Open Language Models ↗

    Almazrouei, Ebtesam, Alobeidli, Hamza, Alshamsi, Abdulaziz, Cappelli, Alessandro, Cojocaru, Ruxandra, Debbah, Mérouane et al. · 2023

    All 14 authors

    Almazrouei, Ebtesam, Alobeidli, Hamza, Alshamsi, Abdulaziz, Cappelli, Alessandro, Cojocaru, Ruxandra, Debbah, Mérouane, Goffinet, Étienne, Hesslow, Daniel, Launay, Julien, Malartic, Quentin, Mazzotta, Daniele, Noune, Badreddine, Pannier, Baptiste, Penedo, Guilherme

  6. Mixtral of Experts ↗

    Jiang, Albert Q., Sablayrolles, Alexandre, Roux, Antoine, Mensch, Arthur, Savary, Blanche, Bamford, Chris et al. · 2024

    All 26 authors

    Jiang, Albert Q., Sablayrolles, Alexandre, Roux, Antoine, Mensch, Arthur, Savary, Blanche, Bamford, Chris, Chaplot, Devendra Singh, Casas, Diego de las, Hanna, Emma Bou, Bressand, Florian, Lengyel, Gianna, Bour, Guillaume, Lample, Guillaume, Lavaud, Lélio Renard, Saulnier, Lucile, Lachaux, Marie-Anne, Stock, Pierre, Subramanian, Sandeep, Yang, Sophia, Antoniak, Szymon, Scao, Teven Le, Gervet, Théophile, Lavril, Thibaut, Wang, Thomas, Lacroix, Timothée, Sayed, William El

  7. Yi: Open Foundation Models by 01.AI ↗

    AI, 01., :, Young, Alex, Chen, Bei, Li, Chao, Huang, Chengen et al. · 2024

    All 33 authors

    AI, 01., :, Young, Alex, Chen, Bei, Li, Chao, Huang, Chengen, Zhang, Ge, Zhang, Guanwei, Wang, Guoyin, Li, Heng, Zhu, Jiangcheng, Chen, Jianqun, Chang, Jing, Yu, Kaidong, Liu, Peng, Liu, Qiang, Yue, Shawn, Yang, Senbin, Yang, Shiming, Xie, Wen, Huang, Wenhao, Hu, Xiaohui, Ren, Xiaoyi, Niu, Xinyao, Nie, Pengcheng, Li, Yanpeng, Xu, Yuchi, Liu, Yudong, Wang, Yue, Cai, Yuxuan, Gu, Zhenyu, Liu, Zhiyuan, Dai, Zonghong

  8. Gemma: Open Models Based on Gemini Research and Technology ↗

    Gemma Team, Mesnard, Thomas, Hardin, Cassidy, Dadashi, Robert, Bhupatiraju, Surya, Pathak, Shreya et al. · 2024

    All 108 authors

    Gemma Team, Mesnard, Thomas, Hardin, Cassidy, Dadashi, Robert, Bhupatiraju, Surya, Pathak, Shreya, Sifre, Laurent, Rivière, Morgane, Kale, Mihir Sanjay, Love, Juliette, Tafti, Pouya, Hussenot, Léonard, Sessa, Pier Giuseppe, Chowdhery, Aakanksha, Roberts, Adam, Barua, Aditya, Botev, Alex, Castro-Ros, Alex, Slone, Ambrose, Héliou, Amélie, Tacchetti, Andrea, Bulanova, Anna, Paterson, Antonia, Tsai, Beth, Shahriari, Bobak, Lan, Charline Le, Choquette-Choo, Christopher A., Crepy, Clément, Cer, Daniel, Ippolito, Daphne, Reid, David, Buchatskaya, Elena, Ni, Eric, Noland, Eric, Yan, Geng, Tucker, George, Muraru, George-Christian, Rozhdestvenskiy, Grigory, Michalewski, Henryk, Tenney, Ian, Grishchenko, Ivan, Austin, Jacob, Keeling, James, Labanowski, Jane, Lespiau, Jean-Baptiste, Stanway, Jeff, Brennan, Jenny, Chen, Jeremy, Ferret, Johan, Chiu, Justin, Mao-Jones, Justin, Lee, Katherine, Yu, Kathy, Millican, Katie, Sjoesund, Lars Lowe, Lee, Lisa, Dixon, Lucas, Reid, Machel, Mikuła, Maciej, Wirth, Mateo, Sharman, Michael, Chinaev, Nikolai, Thain, Nithum, Bachem, Olivier, Chang, Oscar, Wahltinez, Oscar, Bailey, Paige, Michel, Paul, Yotov, Petko, Chaabouni, Rahma, Comanescu, Ramona, Jana, Reena, Anil, Rohan, McIlroy, Ross, Liu, Ruibo, Mullins, Ryan, Smith, Samuel L, Borgeaud, Sebastian, Girgin, Sertan, Douglas, Sholto, Pandya, Shree, Shakeri, Siamak, De, Soham, Klimenko, Ted, Hennigan, Tom, Feinberg, Vlad, Stokowiec, Wojciech, Chen, Yu-hui, Ahmed, Zafarali, Gong, Zhitao, Warkentin, Tris, Peran, Ludovic, Giang, Minh, Farabet, Clément, Vinyals, Oriol, Dean, Jeff, Kavukcuoglu, Koray, Hassabis, Demis, Ghahramani, Zoubin, Eck, Douglas, Barral, Joelle, Pereira, Fernando, Collins, Eli, Joulin, Armand, Fiedel, Noah, Senter, Evan, Andreev, Alek, Kenealy, Kathleen

  9. CMMLU: Measuring massive multitask language understanding in Chinese — published result table ↗

    Li, Haonan, Zhang, Yixuan, Koto, Fajri, Yang, Yifei, Zhao, Hai, Gong, Yeyun et al. · 2023

    All 8 authors

    Li, Haonan, Zhang, Yixuan, Koto, Fajri, Yang, Yifei, Zhao, Hai, Gong, Yeyun, Duan, Nan, Baldwin, Timothy

  10. SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models — published result table ↗

    Wang, Xiaoxuan, Hu, Ziniu, Lu, Pan, Zhu, Yanqiao, Zhang, Jieyu, Subramaniam, Satyen et al. · 2023

    All 10 authors

    Wang, Xiaoxuan, Hu, Ziniu, Lu, Pan, Zhu, Yanqiao, Zhang, Jieyu, Subramaniam, Satyen, Loomba, Arjun R., Zhang, Shichang, Sun, Yizhou, Wang, Wei

  11. BizBench: A Quantitative Reasoning Benchmark for Business and Finance — published result table ↗

    Rik Koncel-Kedziorski, Michael Krumdick, Viet Lai, Varshini Reddy, Charles Lovering, Chris Tanner · 2023

  12. ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic — published result table ↗

    Koto, Fajri, Li, Haonan, Shatnawi, Sara, Doughman, Jad, Sadallah, Abdelrahman Boda, Alraeesi, Aisha et al. · 2024

    All 13 authors

    Koto, Fajri, Li, Haonan, Shatnawi, Sara, Doughman, Jad, Sadallah, Abdelrahman Boda, Alraeesi, Aisha, Almubarak, Khalid, Alyafeai, Zaid, Sengupta, Neha, Shehata, Shady, Habash, Nizar, Nakov, Preslav, Baldwin, Timothy

  13. GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers — published result table ↗

    Qintong Li, Leyang Cui, Xueliang Zhao, Lingpeng Kong, Wei Bi · 2024

  14. MathScale: Scaling Instruction Tuning for Mathematical Reasoning — published result table ↗

    Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei · 2024

  15. Large Language Models in the Clinic: A Comprehensive Benchmark — published result table ↗

    Liu, Fenglin, Li, Zheng, Zhou, Hongjian, Yin, Qingyu, Yang, Jingfeng, Tang, Xianfeng et al. · 2024

    All 19 authors

    Liu, Fenglin, Li, Zheng, Zhou, Hongjian, Yin, Qingyu, Yang, Jingfeng, Tang, Xianfeng, Luo, Chen, Zeng, Ming, Jiang, Haoming, Gao, Yifan, Nigam, Priyanka, Nag, Sreyashi, Yin, Bing, Hua, Yining, Zhou, Xuan, Rohanian, Omid, Thakur, Anshul, Clifton, Lei, Clifton, David A.

  16. The Art of Saying No: Contextual Noncompliance in Language Models — published result table ↗

    Brahman, Faeze, Kumar, Sachin, Balachandran, Vidhisha, Dasigi, Pradeep, Pyatkin, Valentina, Ravichander, Abhilasha et al. · 2024

    All 14 authors

    Brahman, Faeze, Kumar, Sachin, Balachandran, Vidhisha, Dasigi, Pradeep, Pyatkin, Valentina, Ravichander, Abhilasha, Wiegreffe, Sarah, Dziri, Nouha, Chandu, Khyathi, Hessel, Jack, Tsvetkov, Yulia, Smith, Noah A., Choi, Yejin, Hajishirzi, Hannaneh

  17. Llama 2: Open Foundation and Fine-Tuned Chat Models ↗

    Touvron, Hugo, Martin, Louis, Stone, Kevin, Albert, Peter, Almahairi, Amjad, Babaei, Yasmine et al. · 2023

    All 68 authors

    Touvron, Hugo, Martin, Louis, Stone, Kevin, Albert, Peter, Almahairi, Amjad, Babaei, Yasmine, Bashlykov, Nikolay, Batra, Soumya, Bhargava, Prajjwal, Bhosale, Shruti, Bikel, Dan, Blecher, Lukas, Ferrer, Cristian Canton, Chen, Moya, Cucurull, Guillem, Esiobu, David, Fernandes, Jude, Fu, Jeremy, Fu, Wenyin, Fuller, Brian, Gao, Cynthia, Goswami, Vedanuj, Goyal, Naman, Hartshorn, Anthony, Hosseini, Saghar, Hou, Rui, Inan, Hakan, Kardas, Marcin, Kerkez, Viktor, Khabsa, Madian, Kloumann, Isabel, Korenev, Artem, Koura, Punit Singh, Lachaux, Marie-Anne, Lavril, Thibaut, Lee, Jenya, Liskovich, Diana, Lu, Yinghai, Mao, Yuning, Martinet, Xavier, Mihaylov, Todor, Mishra, Pushkar, Molybog, Igor, Nie, Yixin, Poulton, Andrew, Reizenstein, Jeremy, Rungta, Rashi, Saladi, Kalyan, Schelten, Alan, Silva, Ruan, Smith, Eric Michael, Subramanian, Ranjan, Tan, Xiaoqing Ellen, Tang, Binh, Taylor, Ross, Williams, Adina, Kuan, Jian Xiang, Xu, Puxin, Yan, Zheng, Zarov, Iliyan, Zhang, Yuchen, Fan, Angela, Kambadur, Melanie, Narang, Sharan, Rodriguez, Aurelien, Stojnic, Robert, Edunov, Sergey, Scialom, Thomas

  18. Mixtral of Experts ↗

    Jiang, Albert Q., Sablayrolles, Alexandre, Roux, Antoine, Mensch, Arthur, Savary, Blanche, Bamford, Chris et al. · 2024

    All 26 authors

    Jiang, Albert Q., Sablayrolles, Alexandre, Roux, Antoine, Mensch, Arthur, Savary, Blanche, Bamford, Chris, Chaplot, Devendra Singh, Casas, Diego de las, Hanna, Emma Bou, Bressand, Florian, Lengyel, Gianna, Bour, Guillaume, Lample, Guillaume, Lavaud, Lélio Renard, Saulnier, Lucile, Lachaux, Marie-Anne, Stock, Pierre, Subramanian, Sandeep, Yang, Sophia, Antoniak, Szymon, Scao, Teven Le, Gervet, Théophile, Lavril, Thibaut, Wang, Thomas, Lacroix, Timothée, Sayed, William El

  19. Gemma: Open Models Based on Gemini Research and Technology ↗

    Gemma Team, Mesnard, Thomas, Hardin, Cassidy, Dadashi, Robert, Bhupatiraju, Surya, Pathak, Shreya et al. · 2024

    All 108 authors

    Gemma Team, Mesnard, Thomas, Hardin, Cassidy, Dadashi, Robert, Bhupatiraju, Surya, Pathak, Shreya, Sifre, Laurent, Rivière, Morgane, Kale, Mihir Sanjay, Love, Juliette, Tafti, Pouya, Hussenot, Léonard, Sessa, Pier Giuseppe, Chowdhery, Aakanksha, Roberts, Adam, Barua, Aditya, Botev, Alex, Castro-Ros, Alex, Slone, Ambrose, Héliou, Amélie, Tacchetti, Andrea, Bulanova, Anna, Paterson, Antonia, Tsai, Beth, Shahriari, Bobak, Lan, Charline Le, Choquette-Choo, Christopher A., Crepy, Clément, Cer, Daniel, Ippolito, Daphne, Reid, David, Buchatskaya, Elena, Ni, Eric, Noland, Eric, Yan, Geng, Tucker, George, Muraru, George-Christian, Rozhdestvenskiy, Grigory, Michalewski, Henryk, Tenney, Ian, Grishchenko, Ivan, Austin, Jacob, Keeling, James, Labanowski, Jane, Lespiau, Jean-Baptiste, Stanway, Jeff, Brennan, Jenny, Chen, Jeremy, Ferret, Johan, Chiu, Justin, Mao-Jones, Justin, Lee, Katherine, Yu, Kathy, Millican, Katie, Sjoesund, Lars Lowe, Lee, Lisa, Dixon, Lucas, Reid, Machel, Mikuła, Maciej, Wirth, Mateo, Sharman, Michael, Chinaev, Nikolai, Thain, Nithum, Bachem, Olivier, Chang, Oscar, Wahltinez, Oscar, Bailey, Paige, Michel, Paul, Yotov, Petko, Chaabouni, Rahma, Comanescu, Ramona, Jana, Reena, Anil, Rohan, McIlroy, Ross, Liu, Ruibo, Mullins, Ryan, Smith, Samuel L, Borgeaud, Sebastian, Girgin, Sertan, Douglas, Sholto, Pandya, Shree, Shakeri, Siamak, De, Soham, Klimenko, Ted, Hennigan, Tom, Feinberg, Vlad, Stokowiec, Wojciech, Chen, Yu-hui, Ahmed, Zafarali, Gong, Zhitao, Warkentin, Tris, Peran, Ludovic, Giang, Minh, Farabet, Clément, Vinyals, Oriol, Dean, Jeff, Kavukcuoglu, Koray, Hassabis, Demis, Ghahramani, Zoubin, Eck, Douglas, Barral, Joelle, Pereira, Fernando, Collins, Eli, Joulin, Armand, Fiedel, Noah, Senter, Evan, Andreev, Alek, Kenealy, Kathleen

  20. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

  21. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

  22. AI benchmarks & capabilities ↗

    Epoch AI

  23. An evaluation framework for clinical use of large language models in patient interaction tasks — official CRAFT-MD leaderboard ↗

    Shreya Johri, Jaehwan Jeong, Benjamin A. Tran, Daniel I. Schlessinger, Shannon Wongvibulsin, Leandra A. Barnes et al. · 2025

    All 12 authors

    Shreya Johri, Jaehwan Jeong, Benjamin A. Tran, Daniel I. Schlessinger, Shannon Wongvibulsin, Leandra A. Barnes, Hong-Yu Zhou, Zhuo Ran Cai, Eliezer M. Van Allen, David Kim, Roxana Daneshjou, Pranav Rajpurkar

  24. ScienceQA — Science Question Answering leaderboard ↗

    ScienceQA Team

  25. LegalBench — evaluation methodology and results ↗

    Vals AI · 2026

Names used in source tables

LLAMA 2 7B · LLaMA-2 7B · LLaMA-2-7B · LLaMA-2-7B‡ · LLaMA-2-7b · LLaMA2 (7B) · LLaMA2-7B* · Llama 2 (7B) · Llama 2 / 7B · Llama 2-7B · Llama-2-7b · Llama2-7B