Skip to content

Llama 3.1 8B Instruct

Meta OPEN Llama 3.1 Community
83% coverage5 of 6 categoriesMissing: Agents & tools. Missing means no data yet, never a zero.
Compare with Gemini 4 Carbon →Compare with any modelMonthly cost
Verdict

Llama 3.1 8B Instruct is behind the leaders: #336 of 406 by SIscope score. Strongest at coding, weaker at math. Cheaper than 98% of priced models. Weights are open, so you can run it yourself.

SIscope score
16
#336 of 406
Human-vote rank
#330
of 419 · score 1187
Price per 1M tokens, blended
$0.058
$0.05 in · $0.08 out
Context window
131K
131,072 tokens

Shape

Each spoke is a category, 0 at the centre, 100 at the edge.

CodingAgentsno data yetReasoningMathChatInstructions

Category scores

Percentiles: 90 means better than about 90% of tested models.

Coding23
Agents & toolsNo data yet–
Reasoning & knowledge13
Math12
Chat quality21
Following instructions21

What goes into each category · Compare with Gemini 4 Carbon

Text arena over time

Rating (solid) and rank (dashed) at each Arena update we have: 3 of 16 snapshots.

118011881195Oct 20: 1186.6 (rank #328)Oct 22: 1186.6 (rank #329)Oct 28: 1186.6 (rank #330)Oct 20Oct 28#1#168#335Oct 20: rank #328Oct 22: rank #329Oct 28: rank #330Oct 20Oct 28

Text arena on Arena ↗

Independent test runs

Run by Epoch AI on the same harness for every model. Bars show the share of questions answered correctly.

PhD-level science multiple choice questions
Better than 4% of 333 tested models. Run Aug 27, 2026.
Competition maths problems in the style of AIME
Better than 4% of 313 tested models. Run Aug 27, 2026.

Human-vote arenas

People compare two anonymous answers and pick the better one. Scores work like chess ratings.

ArenaRankScoreRange (95%)VotesUpdated
Text arena ↗
Everyday chat, blind human votes
#330 of 41911871183–119149,605Oct 28, 2026
WebDev arena ↗
Building web apps, blind human votes
Not on this board yet
Vision arena ↗
Questions about images, blind human votes
Not on this board yet
Agent arena ↗
Real multi-step agent sessions
Not on this board yet

Source: Arena (formerly LMArena) leaderboard dataset, CC BY 4.0. Fetched Nov 4, 2026.

Price

Input
$0.05
per 1M tokens
Output
$0.08
per 1M tokens
Blended
$0.058
3 in : 1 out, per 1M
Context window
131K
max tokens per request
Speed
Coming soon
our own tests

List price from the OpenRouter models API, Nov 4, 2026: meta-llama/llama-3.1-8b-instruct on OpenRouter ↗. Providers can charge differently.