Leaderboard / Google
Gemma 3 27B IT
Google OPEN Gemma
Verdict
Gemma 3 27B IT is behind the leaders: #241 of 406 by SIscope score. Strongest at chat quality, weaker at math. Weights are open, so you can run it yourself.
SIscope score
38
#241 of 406
Human-vote rank
#202
of 419 · score 1358
Price per 1M tokens, blended
No price yet
Not listed on OpenRouter
Context window
No data yet
Speed: coming soon
Shape
Each spoke is a category, 0 at the centre, 100 at the edge.
Category scores
Percentiles: 90 means better than about 90% of tested models.
Human-vote score over time
Text arena, recent updates.
Independent test runs
Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.
GPQA Diamond48%
PhD-level science multiple choice questions
Better than 22% of 333 tested models. Run Aug 27, 2026.
OTIS Mock AIME 2024-2523%
Competition maths problems in the style of AIME
Better than 21% of 313 tested models. Run Aug 27, 2026.
Human-vote arenas
People compare two anonymous answers and pick the better one. Scores work like chess ratings.
| Arena | Rank | Score | Range (95%) | Votes | Updated |
|---|---|---|---|---|---|
| Text arena Everyday chat, blind human votes | #202 of 419 | 1358 | 1354–1361 | 46,670 | Oct 28, 2026 |
| WebDev arena Building web apps, blind human votes | Not on this board yet | ||||
| Vision arena Questions about images, blind human votes | #112 of 167 | 1165 | 1157–1173 | 16,982 | Oct 19, 2026 |
| Agent arena Real multi-step agent sessions | Not on this board yet | ||||
Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.
Price
No public list price yet. We only show prices from the OpenRouter models API, and this model isn't listed there under a matching name.