Model record

o3

OpenAI · released Apr 16, 2025

Overall standing

Overall
44.7rank 43 of 63
44.7 is at approximately the 33th percentile of the ranked Overall field. The field spans 19.0 to 62.2, with a median of 49.4.
6 of 8 measured · 2 estimated
Category standingsReasoning 60.9Coding 48.2Math 1.1Agentic 16.2
Reasoning
60.9rank 43 of 63
60.9 is at approximately the 33th percentile of the ranked Reasoning field. The field spans 31.6 to 73.3, with a median of 65.0.
4 of 4 measured
Coding
48.2rank 42 of 63
48.2 is at approximately the 34th percentile of the ranked Coding field. The field spans 10.4 to 72.4, with a median of 54.5.
1 of 2 measured · 1 estimated
Math
1.1rank 49 of 63
1.1 is at approximately the 21th percentile of the ranked Math field. The field spans 0.0 to 32.3, with a median of 5.7.
1 of 1 measured
Agentic
16.2rank 40 of 63
16.2 is at approximately the 37th percentile of the ranked Agentic field. The field spans 3.3 to 33.4, with a median of 19.0.
0 of 1 measured · 1 estimated
Model factsProprietary · $2.0 / $8.0 per 1M

Model facts come from the provider page. Listed API prices carry a separate first-party source and check date.

Provider
OpenAI
Released
Weights
Proprietary
Context window
200,000 tokens
Input price / Mtok
$2.0
Output price / Mtok
$8.0
Price source
Official pricing (opens in a new tab)
Reasoning effort
Not listed

Scores and sources

Measured scores retain their source and retrieval date. Missing scores are not treated as zero.

Benchmark scores, evaluation settings, sources, and retrieval dates for o3
BenchmarkCategoryScoreEvaluation settingsSource
Terminal-Bench v2.1Coding—Not measured in this datasetNo source
τ³-BankingAgentic—Not measured in this datasetNo source
AA-LCRReasoning69.3Artificial Analysis independent run; 100 roughly 100k-token multi-document questions; 3 repeats; equality-checker pass@1; no toolsOpen source (opens in a new tab)
Humanity's Last ExamReasoning20.0Artificial Analysis independent run; 2,158 text-only questions; pass@1; GPT-4o (August 2024) equality checker; no toolsOpen source (opens in a new tab)
GPQA DiamondReasoning82.7Artificial Analysis independent run; 198 questions; 5 repeats; regex-graded pass@1; no toolsOpen source (opens in a new tab)
SciCodeCoding41.0Artificial Analysis independent run; 288 test subproblems; scientist background included; 3 repeats; subproblem pass@1Open source (opens in a new tab)
IFBenchReasoning71.4Artificial Analysis independent run; 294 single-turn prompts; 5 repeats; official loose evaluator; prompt-level pass@1Open source (opens in a new tab)
CritPtMath1.1Artificial Analysis independent run; 70 test challenges; 5 repeats; two-step answer parsing; official CritPt grader; pass@1; no toolsOpen source (opens in a new tab)