Gemini 1.5 Pro: benchmarks and ranking
Gemini 1.5 Pro (Google) — overall rank: #133 / 153, overall score: 18.4 (90% interval 13.9–24.0), leaderboards: 4. Released: 2024-05-14
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #140 / 230 | 130.45 |
| ARC Prize (ARC-AGI) | #82 / 95 | 0.8 |
| Scale AI SEAL | #39 / 44 | 4.6 |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | #94 / 112 | 27.1 |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 19.0
- Reasoning: 20.4
- Math: 22.8
- Knowledge: 40.7
- Writing: 36.9
- Instructions: 16.4
- Chat & EQ: 10.8
- Business: 47.9
- Japanese: 49.4
- Vision: 18.3