Claude Sonnet 3.5: benchmarks and ranking
Claude Sonnet 3.5 (Anthropic) — overall rank: #134 / 153, overall score: 18.3 (90% interval 12.3–26.4), leaderboards: 2. Released: 2024-06-20
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #134 / 230 | 133.36 |
| ARC Prize (ARC-AGI) | Not rated | — |
| Scale AI SEAL | #42 / 44 | 4.08 |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | Not rated | — |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 36.8
- Reasoning: 23.5
- Math: 22.5
- Knowledge: 41.5
- Writing: 43.4
- Instructions: 25.9
- Chat & EQ: 24.2
- Business: 52.7
- Japanese: 48.1
- Vision: 13.1