Leaderboard / Anthropic
Claude 3.5 Sonnet
Anthropic 2024-06-20 CLOSED Proprietary
Other settings:2024-10-22 · 36
Verdict
Claude 3.5 Sonnet is behind the leaders: #267 of 406 by SIscope score. Strongest at following instructions, weaker at math.
SIscope score
32
#267 of 406
Human-vote rank
#274
of 419 · score 1281
Price per 1M tokens, blended
No price yet
Not listed on OpenRouter
Context window
No data yet
Speed: coming soon
Shape
Each spoke is a category, 0 at the centre, 100 at the edge.
Category scores
Percentiles: 90 means better than about 90% of tested models.
What goes into each category · Compare with DeepSeek V4.1 Flash
Human-vote score over time
Text arena, recent updates.
Independent test runs
Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.
GPQA Diamond54%
PhD-level science multiple choice questions
Better than 28% of 333 tested models. Run Jan 27, 2025.
OTIS Mock AIME 2024-257%
Competition maths problems in the style of AIME
Better than 13% of 313 tested models. Run Feb 25, 2025.
Human-vote arenas
People compare two anonymous answers and pick the better one. Scores work like chess ratings.
| Arena | Rank | Score | Range (95%) | Votes | Updated |
|---|---|---|---|---|---|
| Text arena Everyday chat, blind human votes | #274 of 419 | 1281 | 1278–1284 | 82,419 | Oct 28, 2026 |
| WebDev arena Building web apps, blind human votes | Not on this board yet | ||||
| Vision arena Questions about images, blind human votes | #128 of 167 | 1120 | 1110–1130 | 21,624 | Oct 19, 2026 |
| Agent arena Real multi-step agent sessions | Not on this board yet | ||||
Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.
Price
No public list price yet. We only show prices from the OpenRouter models API, and this model isn't listed there under a matching name.