o1 Mini: benchmarks and ranking
o1 Mini (OpenAI) — overall rank: #139 / 153, overall score: 16.9 (90% interval 11.5–24.2), leaderboards: 3. Released: 2024-09-12
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #129 / 230 | 135.27 |
| ARC Prize (ARC-AGI) | #82 / 95 | 0.8 |
| Scale AI SEAL | Not rated | — |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | #108 / 112 | 18.1 |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 24.8
- Reasoning: 13.7
- Math: 32.8
- Knowledge: 38.5
- Writing: 17.3
- Instructions: 14.6
- Chat & EQ: 9.8
- Business: 43.1
- Japanese: 40.6