Gemini 1.5 Pro: benchmarks and ranking
Gemini 1.5 Pro (Google) — overall rank: #114 / 138, overall score: 22.6 (90% interval 17.0–29.3), leaderboards: 4. Released: 2024-02-15
Rank on each leaderboard
| Leaderboard | Rank | Published value |
|---|---|---|
| Artificial Analysis | Not rated | — |
| LiveBench | Not rated | — |
| Epoch AI | #129 / 239 | 131.73 |
| ARC Prize (ARC-AGI) | #66 / 79 | 0.8 |
| Scale AI SEAL | #37 / 42 | 4.6 |
| Vals AI | Not rated | — |
| Terminal-Bench | Not rated | — |
| EQ-Bench | Not rated | — |
| SimpleBench | #81 / 99 | 27.1 |
| BenchLM.ai | Not rated | — |
Domain scores
- Coding: 18.3
- Reasoning: 20.4
- Math: 27.2
- Knowledge: 44.3
- Writing: 39.2
- Instructions: 17.7
- Chat & EQ: 10.8
- Business: 49.6
- Japanese: 53.5
- Vision: 13.3