RLTasksby ulam.ai
Models / Meta

Meta / MODEL EVIDENCE

Muse Spark

31 benchmarks · 33 observations · 33 sources · released 2026-04-08

Scores at a glance

31 benchmarks · large dot: Muse Spark; small dots: closest models where reported

IFBench ↗75.92%
75.5883.33

Muse Spark · IFBench · AA implementation ↗

Fortress ↗20.22%
5.7874.39

Muse Spark · Scale Labs · Risk elicitation score ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

20.0 percentile-point gap

17 of 25 shared benchmark comparisons

21.6 percentile-point gap

18 of 25 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Arena leaderboard — WebDev evaluation ↗

    Arena

  2. IFBench Benchmark | Artificial Analysis ↗

    Artificial Analysis

  3. MMMU-Pro Benchmark | Artificial Analysis ↗

    Artificial Analysis

  4. SciCode Benchmark | Artificial Analysis ↗

    Artificial Analysis

  5. Terminal-Bench Hard Benchmark | Artificial Analysis ↗

    Artificial Analysis

  6. CritPt v1 ↗

    Epoch AI

  7. FrontierMath Tier 4 (v1, old) ↗

    Epoch AI

  8. FrontierMath Tiers 1-3 (v1, old) ↗

    Epoch AI

  9. GPQA Diamond ↗

    Epoch AI

  10. Humanity's Last Exam ↗

    Epoch AI

  11. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  12. AI benchmarks & capabilities ↗

    Epoch AI

  13. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  14. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  15. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  16. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  17. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  18. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  19. SWE Atlas - Test Writing — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  20. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  21. AIME — evaluation methodology and results ↗

    Vals AI · 2026

  22. CaseLaw — evaluation methodology and results ↗

    Vals AI · 2026

  23. CorpFin — evaluation methodology and results ↗

    Vals AI · 2026

  24. GPQA Diamond — evaluation methodology and results ↗

    Vals AI · 2026

  25. LegalBench — evaluation methodology and results ↗

    Vals AI · 2026

  26. MedCode — evaluation methodology and results ↗

    Vals AI · 2026

  27. MedScribe — evaluation methodology and results ↗

    Vals AI · 2026

  28. MMLU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  29. MMMU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  30. ProofBench — evaluation methodology and results ↗

    Vals AI · 2026

  31. SWE-bench Verified — evaluation methodology and results ↗

    Vals AI · 2026

  32. TaxEval — evaluation methodology and results ↗

    Vals AI · 2026

  33. Vibe Code Bench — evaluation methodology and results ↗

    Vals AI · 2026

Names used in source tables

Muse Spark · Muse Spark (Mini-SWE-agent) · Muse Spark (OpenHands)