Project benchmark

ARC-AGI-1 · Abstract reasoning

ARC Prize · 289 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-28· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Run configurations remain separate, including different reasoning settings.
  • Individual test dates are not given. Update dates and model release dates from the report remain separate and do not substitute for actual test dates.
  • Costs follow the report’s run scope and dollar amounts; they are not model API unit prices.
  • ARC-AGI-1 · Semi-private evaluation set. Benchmark versions are compared separately.
  • Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.
  • Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.
  • Human reference results are shown separately and excluded from model/system rankings and cost comparisons.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Task score

Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.: showing 8 of 289 records with values. See details for configurations and dates.

Chart data · 8 entries
Name%
Claude Fable 5 (Max)98.5
Claude Fable 5 (XHigh)98.5
Claude Opus 5.5 (High)98.5
Gemini 3.8 Flash (High)98.5
Gemini 4 Argon (High)98.5
Gemini 4 Argon (Medium)98.5
GPT-6 Astra (High)98.5
GPT-6 Astra (XHigh)98.5

Cost per task

Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.: showing 8 of 289 records with values. See details for configurations and dates.

Chart data · 8 entries
NameUSD / Task
GPT-5 Nano (Minimal)0.002
GPT-4.1-Nano0.002
GPT-6 Luna (None)0.002
DeepSeek V4 Flash 0731 (None)0.002
Qwen3-235b-a22b Instruct (25/07)0.003
GPT-6 Luna (Low)0.003
GPT-5 Nano (Low)0.003
Nemotron 3.5 Super VL (None)0.004

Human reference

Human baselines are shown separately and are not ranked alongside models and systems.

Stem Grad

Task score
98%
Cost per task
10 USD / Task

Human Panel

Task score
98%
Cost per task
17 USD / Task

Full results & model versions

289 / 289configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

GPT-5.6 Luna 2026-07-30 (Low)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-luna-2026-07-30 · CoT

Release time reported by the benchmark:

Task score
39.5%
Cost per task
0.008206 USD / Task

Claude Opus 4.6 (120K, Max)

Model reported by the benchmark

As reportedOrganization: Anthropic

claude-opus-4-6-thinking · CoT

Release time reported by the benchmark:

Task score
93%
Cost per task
1.8791 USD / Task

GPT-5.6 Luna (Low)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-luna · CoT

Release time reported by the benchmark:

Task score
34.17%
Cost per task
0.04 USD / Task

GPT-5.2 Pro (XHigh)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-2-pro-2025-12-11-thinking · CoT

Release time reported by the benchmark:

Task score
90.5%
Cost per task
11.6542 USD / Task

Nemotron 3.5 Super VL (Medium)

Model reported by the benchmark

As reportedOrganization: NVIDIA

nvidia-nemotron-3-5-super-vl-120b-a12b · CoT

Release time reported by the benchmark:

Task score
20.16666666666667%
Cost per task
0.012163 USD / Task

Muse Spark Open (High)

Model reported by the benchmark

As reportedOrganization: Meta AI

meta-muse-spark-open · CoT

Release time reported by the benchmark:

Task score
88.5%
Cost per task
0.231249 USD / Task

DeepSeek V4.1 Flash (High)

Model reported by the benchmark

As reportedOrganization: DeepSeek

deepseek-v4-1-flash · CoT

Release time reported by the benchmark:

Task score
88.5%
Cost per task
0.063288 USD / Task

Claude Sonnet 4.6 (Max)

Model reported by the benchmark

As reportedOrganization: Anthropic

claude-sonnet-4-6 · CoT

Release time reported by the benchmark:

Task score
86%
Cost per task
1.452 USD / Task

GPT-5.5 (XHigh)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-5-2026-04-22-thinking · CoT

Release time reported by the benchmark:

Task score
95%
Cost per task
0.73 USD / Task

GPT-4.1-Nano

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-4.1 · Base LLM

Release time reported by the benchmark:

Task score
0%
Cost per task
0.0021 USD / Task

Claude Fable 5 (XHigh)

Model reported by the benchmark

As reportedOrganization: Anthropic

anthropic-claude-fable-5 · CoT

Release time reported by the benchmark:

Task score
98.5%
Cost per task
1.022434 USD / Task

GLM-5.2

Model reported by the benchmark

As reportedOrganization: Z.ai

CoT

Release time reported by the benchmark:

Task score
77%
Cost per task
0.1916 USD / Task

GPT-5.6 Terra (Max)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-terra · CoT

Release time reported by the benchmark:

Task score
96.5%
Cost per task
0.55 USD / Task

GPT-6 Luna (Max)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-luna · CoT

Release time reported by the benchmark:

Task score
86.66666666666667%
Cost per task
0.018388 USD / Task

Tiny Recursion Model (TRM)

Model reported by the benchmark

As reportedOrganization: Bespoke

Release time reported by the benchmark:

Task score
40%
Cost per task
1.7638 USD / Task

Gemini 2.5 Flash (Preview) (Thinking 1K)

Model reported by the benchmark

As reportedOrganization: Google

gemini-2-5-flash-preview-05-20-thinking · CoT

Release time reported by the benchmark:

Task score
16%
Cost per task
0.0356 USD / Task

GPT-5.5 (Medium)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-5-2026-04-22-thinking · CoT

Release time reported by the benchmark:

Task score
92.17%
Cost per task
0.39 USD / Task

Magistral Small

Model reported by the benchmark

As reportedOrganization: Mistral

CoT

Release time reported by the benchmark:

Task score
5%
Cost per task
0.0399 USD / Task

GPT-6.1 Sol (High)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-1-sol · CoT

Release time reported by the benchmark:

Task score
98.5%
Cost per task
0.059255 USD / Task

GPT-4o

Model reported by the benchmark

As reportedOrganization: OpenAI

Base LLM

Release time reported by the benchmark:

Task score
4.5%
Cost per task
0.05 USD / Task