Model record

Muse Spark

Meta · released Apr 8, 2026

Overall standing

Overall
52.3rank 25 of 63
52.3 is at approximately the 61th percentile of the ranked Overall field. The field spans 19.0 to 62.2, with a median of 49.4.
8 of 8 measured
Category standingsReasoning 68.5Coding 56.8Math 11.3Agentic 19.6
Reasoning
68.5rank 18 of 63
68.5 is at approximately the 72th percentile of the ranked Reasoning field. The field spans 31.6 to 73.3, with a median of 65.0.
4 of 4 measured
Coding
56.8rank 29 of 63
56.8 is at approximately the 55th percentile of the ranked Coding field. The field spans 10.4 to 72.4, with a median of 54.5.
2 of 2 measured
Math
11.3rank 23 of 63
11.3 is at approximately the 64th percentile of the ranked Math field. The field spans 0.0 to 32.3, with a median of 5.7.
1 of 1 measured
Agentic
19.6rank 30 of 63
19.6 is at approximately the 52th percentile of the ranked Agentic field. The field spans 3.3 to 33.4, with a median of 19.0.
1 of 1 measured
Model factsProprietary · Price not listed

Model facts come from the provider page. Listed API prices carry a separate first-party source and check date.

Scores and sources

Measured scores retain their source and retrieval date. Missing scores are not treated as zero.

Benchmark scores, evaluation settings, sources, and retrieval dates for Muse Spark
BenchmarkCategoryScoreEvaluation settingsSource
Terminal-Bench v2.1Coding62.2Artificial Analysis independent run; 89 tasks; Terminus 2 on E2B; 3 repeats; pass@1; 250-episode cap; 2-hour timeoutOpen source (opens in a new tab)
τ³-BankingAgentic19.6Artificial Analysis independent run; 97 tasks; 5 repeats; backend-state pass@1; BM25 plus grep retrieval; 200-step capOpen source (opens in a new tab)
AA-LCRReasoning69.7Artificial Analysis independent run; 100 roughly 100k-token multi-document questions; 3 repeats; equality-checker pass@1; no toolsOpen source (opens in a new tab)
Humanity's Last ExamReasoning39.9Artificial Analysis independent run; 2,158 text-only questions; pass@1; GPT-4o (August 2024) equality checker; no toolsOpen source (opens in a new tab)
GPQA DiamondReasoning88.4Artificial Analysis independent run; 198 questions; 5 repeats; regex-graded pass@1; no toolsOpen source (opens in a new tab)
SciCodeCoding51.5Artificial Analysis independent run; 288 test subproblems; scientist background included; 3 repeats; subproblem pass@1Open source (opens in a new tab)
IFBenchReasoning75.9Artificial Analysis independent run; 294 single-turn prompts; 5 repeats; official loose evaluator; prompt-level pass@1Open source (opens in a new tab)
CritPtMath11.3Artificial Analysis independent run; 70 test challenges; 5 repeats; two-step answer parsing; official CritPt grader; pass@1; no toolsOpen source (opens in a new tab)