📡 LLM Pulse|🆕 New on leaderboard: Baidu: ERNIE-Light-DT-1.0 by Baidu — $1.13/M tokens1/10
Measurement sources and verification status (10 fields)

Collected third-party figures are not independent tests. A source link and collection date do not establish reproducibility. Exact model version, dataset and test settings may be missing. No independent verification date is supplied.

speed: 69
latency: 0.38
contextWindow: 131072
benchmarkMmlu: 87.5
benchmarkHumanEval: 89
benchmarkMath: 92
benchmarkGpqa: 69.5
reasoningScore: 81
codingScore: 89
benchmarkSweBench: 48

DeepSeek-V4-Pro-MaxDeepSeek

DeepSeek🔓 Open Source
7.2
LLM Stats Scores
81.0
Reasoning
89.0
Coding
🎯
69.5%GPQA Diamond — graduate-level science accuracy
Published benchmark evidence
Task scores are reported independently by each publisher; they are not combined into a hidden quality score.
48.0%
SWE-bench
Quality Score
85.0
Overall (0–100)
Speed
69 c/s
characters/second
Latency (TTFT)
0.38s
to first token
Input Price
—
per 1M tokens
Output Price
—
per 1M tokens
Context Window
131K
tokens
Release Date
2025-11

30-Day Rank History

📊 Benchmark Scores

Reported scores · % accuracy
0%25%50%75%100%GPQA ◆MMLUHumanEvalMATH69.5%87.5%89.0%92.0%
What do these benchmarks test?
🎯
GPQA Diamond69.5%Below avg
Designed so that even PhD-level human experts average ~65–70%. A score above 80% signals near-expert scientific reasoning that goes far beyond memorisation.
🧠
MMLU87.5%Top tier
The classic academic breadth benchmark. Top frontier models now score above 85%, so it best distinguishes mid-tier from strong generalist models.
💻
HumanEval89.0%Solid
Measures whether a model writes functionally correct code — not just plausible-looking syntax. Strong scores (>85%) indicate reliable day-to-day coding assistance.
∑
MATH Benchmark92.0%Top tier
Tests multi-step mathematical reasoning under strict correctness. Even a 60% score requires strong chain-of-thought; top reasoning models now exceed 90%.

💰 Cost Calculator

Pricing not available for this model.

AI Score

Powered by Groq
7.8/10

"Open‑source, solid performance and large context, yet still trails top commercial models in consistency."

🤖 AI Analysis

Compare Similar Models

Other models on LLM Pulse

⚔ Battle This Model← Back