activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 0k context · historical v0 leaderboard ↗
53 more reported results
43% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
23% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
8% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
6% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
52% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
47% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
36% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
16% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1–QA5 average · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
85% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 0k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
81% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
67% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
65% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
48% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
21% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
16% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
6% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
5% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA1 · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
52% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 0k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
37% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
28% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
25% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
23% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
11% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
9% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
4% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
2% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA2 · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
33% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 0k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
25% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
25% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
21% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
20% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
17% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
13% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
5% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
5% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA3 · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
40% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 0k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
50% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
52% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
43% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
34% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
22% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
14% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
9% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
10% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA4 · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
65% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 0k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
67% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 1k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
64% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 2k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
63% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 4k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
57% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 8k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
45% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 16k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
29% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 32k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
17% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 64k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗
7% · activation-beacon-llama2-7b-chat · BABILong · BABILong v0 · QA5 · 128k context · historical v0 leaderboard · BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — official v0 leaderboard ↗