Verdict
GPT-5.1 is a solid mid-pack model: #120 of 406 by SIscope score. Strongest at following instructions, weaker at coding. Mid-range on price.
SIscope score
64
#120 of 406
Human-vote rank
#70
of 419 · score 1443
Price per 1M tokens, blended
$3.44
$1.25 in · $10 out
Context window
400K
400,000 tokens
Shape
Each spoke is a category, 0 at the centre, 100 at the edge.
Category scores
Percentiles: 90 means better than about 90% of tested models.
What goes into each category · Compare with DeepSeek V4.1 Flash
Human-vote score over time
Text arena, recent updates.
Independent test runs
Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.
GPQA Diamond88%
PhD-level science multiple choice questions
Better than 76% of 333 tested models. Run Nov 13, 2025.
SimpleQA Verified48%
Short factual questions; rewards not making things up
Better than 67% of 100 tested models. Run Aug 27, 2026.
OTIS Mock AIME 2024-2589%
Competition maths problems in the style of AIME
Better than 71% of 313 tested models. Run Nov 13, 2025.
SWE-bench Verified68%
Fixing real GitHub issues in Python repositories
Better than 24% of 35 tested models. Run Feb 18, 2026.
Human-vote arenas
People compare two anonymous answers and pick the better one. Scores work like chess ratings.
| Arena | Rank | Score | Range (95%) | Votes | Updated |
|---|---|---|---|---|---|
| Text arena Everyday chat, blind human votes | #70 of 419 | 1443 | 1439–1446 | 41,639 | Oct 28, 2026 |
| WebDev arena Building web apps, blind human votes | Not on this board yet | ||||
| Vision arena Questions about images, blind human votes | #64 of 167 | 1250 | 1242–1257 | 9,848 | Oct 19, 2026 |
| Agent arena Real multi-step agent sessions | Not on this board yet | ||||
Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.
Price
Input
$1.25
per 1M tokens
Output
$10
per 1M tokens
Blended
$3.44
3 in : 1 out, per 1M
Context window
400K
max tokens per request
Speed
Coming soon
our own tests
List price from the OpenRouter models API (openai/gpt-5.1), Nov 4, 2026. Providers can charge differently.