Leaderboard / Google
Gemma 3 4B IT
Google OPEN Gemma
Verdict
Gemma 3 4B IT is behind the leaders: #308 of 406 by SIscope score. Strongest at chat quality, weaker at reasoning & knowledge. Weights are open, so you can run it yourself.
SIscope score
23
#308 of 406
Human-vote rank
#258
of 419 · score 1291
Price per 1M tokens, blended
No price yet
Not listed on OpenRouter
Context window
No data yet
Speed: coming soon
Shape
Each spoke is a category, 0 at the centre, 100 at the edge.
Category scores
Percentiles: 90 means better than about 90% of tested models.
Human-vote score over time
Text arena, recent updates.
Independent test runs
Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.
GPQA Diamond23%
PhD-level science multiple choice questions
Better than 2% of 333 tested models. Run Aug 28, 2026.
OTIS Mock AIME 2024-258%
Competition maths problems in the style of AIME
Better than 14% of 313 tested models. Run Aug 28, 2026.
Human-vote arenas
People compare two anonymous answers and pick the better one. Scores work like chess ratings.
| Arena | Rank | Score | Range (95%) | Votes | Updated |
|---|---|---|---|---|---|
| Text arena Everyday chat, blind human votes | #258 of 419 | 1291 | 1282–1300 | 4,171 | Oct 28, 2026 |
| WebDev arena Building web apps, blind human votes | Not on this board yet | ||||
| Vision arena Questions about images, blind human votes | Not on this board yet | ||||
| Agent arena Real multi-step agent sessions | Not on this board yet | ||||
Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.
Price
No public list price yet. We only show prices from the OpenRouter models API, and this model isn't listed there under a matching name.