Claude Sonnet 3.5: benchmarks and ranking
Claude Sonnet 3.5 (Anthropic) — overall rank: #118 / 138, overall score: 21.8 (90% interval 14.7–30.9), leaderboards: 2. Released: 2024-06-01
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #125 / 239 | 133.55 |
| ARC Prize (ARC-AGI) | Not rated | — |
| Scale AI SEAL | #40 / 42 | 4.08 |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | Not rated | — |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 37.1
- Reasoning: 24.0
- Math: 26.3
- Knowledge: 45.2
- Writing: 45.0
- Instructions: 28.0
- Chat & EQ: 24.7
- Business: 54.6
- Japanese: 51.9
- Vision: 9.1