Llama 3.1 405B: benchmarks and ranking
Llama 3.1 405B (Meta) — overall rank: #149 / 153, overall score: 12.9 (90% interval 7.0–22.5), leaderboards: 2. Released: 2024-07-23
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #144 / 230 | 127.92 |
| ARC Prize (ARC-AGI) | Not rated | — |
| Scale AI SEAL | Not rated | — |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | #99 / 112 | 23 |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 22.8
- Reasoning: 14.6
- Math: 17.8
- Knowledge: 33.3
- Writing: 14.1
- Instructions: 11.5
- Chat & EQ: 12.6
- Business: 46.3
- Japanese: 39.8