RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

Alpaca 65B

1 benchmarks · 1 observations · 1 sources

Scores at a glance

1 benchmarks · large dot: Alpaca 65B; small dots: closest models where reported

FActScore ↗55.6%
17.373.1

Alpaca 65B · FActScore · estimator A · Unlabeled entity-biography evaluation ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

9.1 percentile-point gap

1 of 1 shared benchmark comparisons

18.2 percentile-point gap

1 of 1 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation — published result table ↗

    Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh et al. · 2023

    All 9 authors

    Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi

Names used in source tables

Alpaca 65B