DeepSeek V3 (0324) · Aider coding benchmarks · Polyglot · percent correct ↗
DeepSeek / MODEL EVIDENCE
DeepSeek V3 (0324)
3 benchmarks · 6 observations · 3 sources
Scores at a glance
3 benchmarks · large dot: DeepSeek V3 (0324); small dots: closest models where reported
LiveCodeBench Pro ↗984 Elo
DeepSeek V3 0324 · LiveCodeBench Pro · Elo rating · human contest calibration ↗
3 more reported results
0% · DeepSeek V3 0324 · LiveCodeBench Pro · Hard · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗
5.6% · DeepSeek V3 0324 · LiveCodeBench Pro · Medium · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗
32.4% · DeepSeek V3 0324 · LiveCodeBench Pro · Easy · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗
DeepSeek-V3-0324 · FrontierMath-2025-02-28-Public · FrontierMath public · 10 questions · source run score · Epoch AI · public February 2025 sample · historical release ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Aider code editing benchmark ↗
- LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? — published result table ↗
All 19 authors
Zihan Zheng, Zerui Cheng, Zeyu Shen, Shang Zhou, Kaiyuan Liu, Hansen He, Dongruixuan Li, Stanley Wei, Hangyi Hao, Jianzhu Yao, Peiyao Sheng, Zixuan Wang, Wenhao Chai, Aleksandra Korolova, Peter Henderson, Sanjeev Arora, Pramod Viswanath, Jingbo Shang, Saining Xie
- A Rosetta Stone for AI Benchmarks — released Epoch evaluation runs ↗
Names used in source tables
DeepSeek V3 (0324) · DeepSeek V3 0324 · DeepSeek-V3-0324