Model record

Muse Spark 1.1

xhigh

Meta · released Jul 9, 2026

Overall standing

Overall
56.2rank 15 of 62
56.2 is at approximately the 77th percentile of the ranked Overall field. The field spans 19.0 to 62.2, with a median of 48.9.
7 of 8 measured · 1 estimated
Category standingsReasoning 68.3Coding 68.1Math 15.1Agentic 25.2
Reasoning
68.3rank 20 of 62
68.3 is at approximately the 69th percentile of the ranked Reasoning field. The field spans 31.6 to 73.3, with a median of 64.8.
3 of 4 measured · 1 estimated
Coding
68.1rank 9 of 46
68.1 is at approximately the 82th percentile of the ranked Coding field. The field spans 10.4 to 72.4, with a median of 56.1.
2 of 2 measured
Math
15.1rank 15 of 62
15.1 is at approximately the 77th percentile of the ranked Math field. The field spans 0.0 to 32.3, with a median of 5.3.
1 of 1 measured
Agentic
25.2rank 17 of 46
25.2 is at approximately the 64th percentile of the ranked Agentic field. The field spans 3.3 to 33.4, with a median of 19.6.
1 of 1 measured
Model factsClosed weights · $1.3 / $4.3 per 1M

Copied from the linked provider page; no separate retrieval date is stored.

Provider
Meta
Released
Weights
Closed weights
Context window
1,048,576 tokens
Input price / Mtok
$1.3
Output price / Mtok
$4.3
Reasoning effort
xhigh effort

Scores and sources

Measured scores retain their source and retrieval date. Missing scores are not treated as zero.

Benchmark scores, evaluation settings, sources, and retrieval dates for Muse Spark 1.1
BenchmarkCategoryScoreEvaluation settingsSource
Terminal-Bench v2.1Coding77.9Artificial Analysis independent run; 89 tasks; Terminus 2 on E2B; 3 repeats; pass@1; 250-episode cap; 2-hour timeoutOpen source (opens in a new tab)
τ³-BankingAgentic25.2Artificial Analysis independent run; 97 tasks; 5 repeats; backend-state pass@1; BM25 plus grep retrieval; 200-step capOpen source (opens in a new tab)
AA-LCRReasoning63.3Artificial Analysis independent run; 100 roughly 100k-token multi-document questions; 3 repeats; equality-checker pass@1; no toolsOpen source (opens in a new tab)
Humanity's Last ExamReasoning45.1Artificial Analysis independent run; 2,158 text-only questions; pass@1; GPT-4o (August 2024) equality checker; no toolsOpen source (opens in a new tab)
GPQA DiamondReasoning89.8Artificial Analysis independent run; 198 questions; 5 repeats; regex-graded pass@1; no toolsOpen source (opens in a new tab)
SciCodeCoding58.2Artificial Analysis independent run; 288 test subproblems; scientist background included; 3 repeats; subproblem pass@1Open source (opens in a new tab)
IFBenchReasoning—Not measured in this datasetNo source
CritPtMath15.1Artificial Analysis independent run; 70 test challenges; 5 repeats; two-step answer parsing; official CritPt grader; pass@1; no toolsOpen source (opens in a new tab)