o1: benchmarks and ranking
o1 (OpenAI) — overall rank: #116 / 153, overall score: 25.2 (90% interval 18.3–33.6), leaderboards: 3. Released: 2024-09-12 · Price (in/out): $16.5 / $66
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #112 / 230 | 141.16 |
| ARC Prize (ARC-AGI) | Not rated | — |
| Scale AI SEAL | #33 / 44 | 7.96 |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | #74 / 112 | 41.7 |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 36.0
- Reasoning: 31.1
- Math: 46.5
- Knowledge: 49.0
- Writing: 44.2
- Instructions: 37.7
- Chat & EQ: 24.1
- Business: 57.8
- Japanese: 62.7
- Vision: 22.9