📡 LLM Pulse|🆕 New on leaderboard: Baidu: ERNIE-Light-DT-1.0 by Baidu — $1.13/M tokens1/10
Measurement sources and verification status (11 fields)

Collected third-party figures are not independent tests. A source link and collection date do not establish reproducibility. Exact model version, dataset and test settings may be missing. No independent verification date is supplied.

speed: 160
latency: 0.28
contextWindow: 1048576
inputPrice: 0.3
outputPrice: 1
benchmarkMmlu: 78
benchmarkHumanEval: 78
benchmarkMath: 74
benchmarkGpqa: 60
reasoningScore: 67
codingScore: 78
R

Reflection: Beam 1.0 501B A23B

reflection🔒 Proprietary
8.0
LLM Stats Scores
67.0
Reasoning
78.0
Coding
🎯
60.0%GPQA Diamond — graduate-level science accuracy
BenchLM performance measurements
Published output speed and first-token timing, kept separate from provider pricing and other benchmark sources.
View source ↗
Output speed
345
tokens / second
TTFT
6.36s
BenchLM measured
Collected 11/11/2026
Quality Score
73.0
Overall (0–100)
Speed
160 c/s
characters/second
Latency (TTFT)
0.28s
to first token
Input Price
$0.3
per 1M tokens
Output Price
$1
per 1M tokens
Context Window
1M
tokens
Release Date
2026-10-16

30-Day Rank History

📊 Benchmark Scores

Reported scores · % accuracy
0%25%50%75%100%GPQA ◆MMLUHumanEvalMATH
What do these benchmarks test?
🎯
GPQA Diamond60.0%Below avg
Designed so that even PhD-level human experts average ~65–70%. A score above 80% signals near-expert scientific reasoning that goes far beyond memorisation.
🧠
MMLU78.0%Solid
The classic academic breadth benchmark. Top frontier models now score above 85%, so it best distinguishes mid-tier from strong generalist models.
💻
HumanEval78.0%Solid
Measures whether a model writes functionally correct code — not just plausible-looking syntax. Strong scores (>85%) indicate reliable day-to-day coding assistance.
∑
MATH Benchmark74.0%Solid
Tests multi-step mathematical reasoning under strict correctness. Even a 60% score requires strong chain-of-thought; top reasoning models now exceed 90%.

💰 Cost Calculator

Input cost
$0.30
Output cost
$0.50
Total / month
$0.80
Annual cost
$9.60
Input: $0.3/1M
Output: $1/1M
Rate: 1 USD = 1.00 USD · 2026-11-10
75.6% cheaper than average
Cheaper alternatives:
Z.ai: GLM 5.2$0.007/1M · Q73

AI Score

Powered by Groq
8.2/10

"Huge 501B parameter count and 1M context deliver strong capabilities, though price restricts wide adoption"

🤖 AI Analysis

⚔ Battle This Model← Back