📡 LLM Pulse|🆕 New on leaderboard: Baidu: ERNIE-Light-DT-1.0 by Baidu — $1.13/M tokensLearn more →1/10

Measurement sources and verification status (16 fields)

Collected third-party figures are not independent tests. A source link and collection date do not establish reproducibility. Exact model version, dataset and test settings may be missing. No independent verification date is supplied.

speed: 80

latency: 0.5

contextWindow: 131072

inputPrice: 0.15

outputPrice: 0.6

benchmarkMmlu: 78

benchmarkHumanEval: 78

benchmarkMath: 74

benchmarkGpqa: 60

reasoningScore: 67

codingScore: 78

aaIntelligenceIndex: 8

aaCostPerTask: 0.08

aaOutputSpeed: 144

aaLatency: 2.47

aaEndToEndTime: 19.86

Upstage: Solar Pro 3

upstage🔒 Proprietary

Solar Pro 3 is Upstage's powerful Mixture-of-Experts (MoE) language model. With 102B total parameters and 12B active parameters per forward pass, it delivers exceptional performance while maintaining computational efficiency. Optimized...

LLM Stats Scores

67.0

Reasoning

78.0

Coding

🎯

60.0%GPQA Diamond — graduate-level science accuracy

Published benchmark evidence

Task scores are reported independently by each publisher; they are not combined into a hidden quality score.

View HLE source ↗

10.3%

Humanity's Last Exam

Artificial Analysis measurements

Published operational results. Cost per task, speed, and latency are kept separate from provider API prices.

Intelligence

AA Index

Cost / task

$0.08

AA measured

Output speed

144

tokens / second

TTFT

2.47s

AA measured

Response time

19.86s

end to end

Quality Score

73.0

Overall (0–100)

Speed

80 c/s

characters/second

Latency (TTFT)

0.50s

to first token

Input Price

$0.15

per 1M tokens

Output Price

$0.6

per 1M tokens

Context Window

131K

tokens

Release Date

2026-01-27

30-Day Rank History

📊 Benchmark Scores

Reported scores · % accuracy

What do these benchmarks test?

🎯

GPQA Diamond60.0%Below avg

Designed so that even PhD-level human experts average ~65–70%. A score above 80% signals near-expert scientific reasoning that goes far beyond memorisation.

🧠

MMLU78.0%Solid

The classic academic breadth benchmark. Top frontier models now score above 85%, so it best distinguishes mid-tier from strong generalist models.

💻

HumanEval78.0%Solid

Measures whether a model writes functionally correct code — not just plausible-looking syntax. Strong scores (>85%) indicate reliable day-to-day coding assistance.

∑

MATH Benchmark74.0%Solid

Tests multi-step mathematical reasoning under strict correctness. Even a 60% score requires strong chain-of-thought; top reasoning models now exceed 90%.