📡 LLM Pulse|🆕 New on leaderboard: Baidu: ERNIE-Light-DT-1.0 by Baidu — $1.13/M tokens1/10
Measurement sources and verification status (14 fields)

Collected third-party figures are not independent tests. A source link and collection date do not establish reproducibility. Exact model version, dataset and test settings may be missing. No independent verification date is supplied.

speed: 80
latency: 0.49
contextWindow: 2000000
inputPrice: 1.25
outputPrice: 2.5
benchmarkMmlu: 91
benchmarkHumanEval: 91
benchmarkMath: 94
benchmarkHellaSwag: 92.5
benchmarkGpqa: 79
benchmarkMmluPro: 78
reasoningScore: 86
codingScore: 91
benchmarkSweBench: 52

xAI: Grok 4.20

x-ai🔒 Proprietary
7.8
LLM Stats Scores
86.0
Reasoning
91.0
Coding
🎯
79.0%GPQA Diamond — graduate-level science accuracy
78.0%MMLU-Pro
Published benchmark evidence
Task scores are reported independently by each publisher; they are not combined into a hidden quality score.
52.0%
SWE-bench
BenchLM performance measurements
Published output speed and first-token timing, kept separate from provider pricing and other benchmark sources.
View source ↗
Output speed
108
tokens / second
TTFT
17.04s
BenchLM measured
Collected 11/11/2026
Quality Score
88.0
Overall (0–100)
Speed
80 c/s
characters/second
Latency (TTFT)
0.49s
to first token
Input Price
$1.25
per 1M tokens
Output Price
$2.5
per 1M tokens
Context Window
2M
tokens
Release Date
2026-03-31

30-Day Rank History

📊 Benchmark Scores

Reported scores · % accuracy
0%25%50%75%100%GPQA ◆MMLU-ProMMLUHumanEvalMATHHellaSwag
What do these benchmarks test?
🎯
GPQA Diamond79.0%Solid
Designed so that even PhD-level human experts average ~65–70%. A score above 80% signals near-expert scientific reasoning that goes far beyond memorisation.
📚
MMLU-Pro78.0%Top tier
The harder successor to MMLU — more options per question eliminate single-answer guessing. Tests depth of professional knowledge across 14 disciplines.
🧠
MMLU91.0%Top tier
The classic academic breadth benchmark. Top frontier models now score above 85%, so it best distinguishes mid-tier from strong generalist models.
💻
HumanEval91.0%Top tier
Measures whether a model writes functionally correct code — not just plausible-looking syntax. Strong scores (>85%) indicate reliable day-to-day coding assistance.
∑
MATH Benchmark94.0%Top tier
Tests multi-step mathematical reasoning under strict correctness. Even a 60% score requires strong chain-of-thought; top reasoning models now exceed 90%.
🌐
HellaSwag92.5%Solid
Tests grounded, everyday common sense rather than memorised facts. Most frontier models now score 90%+, so it best separates small/mid models from large ones.

💰 Cost Calculator

Input cost
$1.25
Output cost
$1.25
Total / month
$2.50
Annual cost
$30.00
Input: $1.25/1M
Output: $2.5/1M
Rate: 1 USD = 1.00 USD · 2026-11-10
23.7% cheaper than average
Cheaper alternatives:
Z.ai: GLM 5.2$0.007/1M · Q73

AI Score

Powered by Groq
8.2/10

"Adds massive 2M token context to Grok 4.3’s strengths, useful for extensive documents."

🤖 AI Analysis