Verdict
Llama 3.1 405B Instruct is behind the leaders: #270 of 406 by SIscope score. Strongest at following instructions, weaker at math. Weights are open, so you can run it yourself.
SIscope score
31
#270 of 406
Human-vote rank
#268
of 419 · score 1284
Price per 1M tokens, blended
No price yet
Not listed on OpenRouter
Context window
No data yet
Speed: coming soon
Shape
Each spoke is a category, 0 at the centre, 100 at the edge.
Category scores
Percentiles: 90 means better than about 90% of tested models.
Human-vote score over time
Text arena, recent updates.
Independent test runs
Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.
GPQA Diamond51%
PhD-level science multiple choice questions
Better than 26% of 333 tested models. Run Jan 27, 2025.
OTIS Mock AIME 2024-2510%
Competition maths problems in the style of AIME
Better than 17% of 313 tested models. Run Feb 25, 2025.
Human-vote arenas
People compare two anonymous answers and pick the better one. Scores work like chess ratings.
| Arena | Rank | Score | Range (95%) | Votes | Updated |
|---|---|---|---|---|---|
| Text arena Everyday chat, blind human votes | #268 of 419 | 1284 | 1280–1287 | 41,375 | Oct 28, 2026 |
| WebDev arena Building web apps, blind human votes | Not on this board yet | ||||
| Vision arena Questions about images, blind human votes | Not on this board yet | ||||
| Agent arena Real multi-step agent sessions | Not on this board yet | ||||
Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.
Price
No public list price yet. We only show prices from the OpenRouter models API, and this model isn't listed there under a matching name.