BALROG ↗10.1%
Llama 3.2 3B · Balrog · Average progress · % ↗
Meta / MODEL EVIDENCE
Llama 3.2 3B
3 benchmarks · 3 observations · 2 sources · released 2024-09-24
Scores at a glance
3 benchmarks · large dot: Llama 3.2 3B; small dots: closest models where reported
Llama-3.2-3B · HELMET (How to Evaluate Long-Context Models Effectively and Thoroughly) · HELMET source aggregate · source model comparison ↗
InfiniteBench ↗1.9 points
Llama-3.2-3B · InfiniteBench · InfiniteBench aggregate · HELMET paper · original-author harness ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly — published result table ↗
All 8 authors
Howard Yen, Tianyu Gao, Minmin Hou, Ke Ding, Daniel Fleischer, Peter Izsak, Moshe Wasserblat, Danqi Chen
- BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ↗
All 13 authors
Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir, Pignatelli, Eduardo, Kuciński, Łukasz, Pinto, Lerrel, Fergus, Rob, Foerster, Jakob Nicolaus, Parker-Holder, Jack, Rocktäschel, Tim
Names used in source tables
Llama 3.2 3B · Llama-3.2-3B