Model record

Llama 4 Maverick

Open weights

Meta · released Apr 5, 2025

Overall standing

Overall
25.7rank 59 of 63
25.7 is at approximately the 7th percentile of the ranked Overall field. The field spans 19.0 to 62.2, with a median of 49.4.
8 of 8 measured
Category standingsReasoning 40.2Coding 20.5Math 0.0Agentic 3.9
Reasoning
40.2rank 59 of 63
40.2 is at approximately the 7th percentile of the ranked Reasoning field. The field spans 31.6 to 73.3, with a median of 65.0.
4 of 4 measured
Coding
20.5rank 62 of 63
20.5 is at approximately the 2th percentile of the ranked Coding field. The field spans 10.4 to 72.4, with a median of 54.5.
2 of 2 measured
Math
0.0rank 54 of 63
0.0 is at approximately the 8th percentile of the ranked Math field. The field spans 0.0 to 32.3, with a median of 5.7.
1 of 1 measured
Agentic
3.9rank 62 of 63
3.9 is at approximately the 2th percentile of the ranked Agentic field. The field spans 3.3 to 33.4, with a median of 19.0.
1 of 1 measured
Model factsOpen weights · Price not listed

Model facts come from the provider page. Listed API prices carry a separate first-party source and check date.

Provider
Meta
Released
Weights
Open weights
Context window
1,000,000 tokens
Input price / Mtok
Not listed
Output price / Mtok
Not listed
Price source
Not listed
Reasoning effort
Not listed

Scores and sources

Measured scores retain their source and retrieval date. Missing scores are not treated as zero.

Benchmark scores, evaluation settings, sources, and retrieval dates for Llama 4 Maverick
BenchmarkCategoryScoreEvaluation settingsSource
Terminal-Bench v2.1Coding7.9Artificial Analysis independent run; 89 tasks; Terminus 2 on E2B; 3 repeats; pass@1; 250-episode cap; 2-hour timeoutOpen source (opens in a new tab)
τ³-BankingAgentic3.9Artificial Analysis independent run; 97 tasks; 5 repeats; backend-state pass@1; BM25 plus grep retrieval; 200-step capOpen source (opens in a new tab)
AA-LCRReasoning46.0Artificial Analysis independent run; 100 roughly 100k-token multi-document questions; 3 repeats; equality-checker pass@1; no toolsOpen source (opens in a new tab)
Humanity's Last ExamReasoning4.8Artificial Analysis independent run; 2,158 text-only questions; pass@1; GPT-4o (August 2024) equality checker; no toolsOpen source (opens in a new tab)
GPQA DiamondReasoning67.1Artificial Analysis independent run; 198 questions; 5 repeats; regex-graded pass@1; no toolsOpen source (opens in a new tab)
SciCodeCoding33.1Artificial Analysis independent run; 288 test subproblems; scientist background included; 3 repeats; subproblem pass@1Open source (opens in a new tab)
IFBenchReasoning43.0Artificial Analysis independent run; 294 single-turn prompts; 5 repeats; official loose evaluator; prompt-level pass@1Open source (opens in a new tab)
CritPtMath0.0Artificial Analysis independent run; 70 test challenges; 5 repeats; two-step answer parsing; official CritPt grader; pass@1; no toolsOpen source (opens in a new tab)