Project benchmark

ARC-AGI-3 · standard framework

ARC Prize · 68 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-28· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Run configurations remain separate, including different reasoning settings.
  • Individual test dates are not given. Update dates and model release dates from the report remain separate and do not substitute for actual test dates.
  • Costs follow the report’s run scope and dollar amounts; they are not model API unit prices.
  • ARC-AGI-3 · Semi-private evaluation set. Benchmark versions are compared separately.
  • Learning efficiency for interactive tasks. A score of 100% matches human efficiency at completing the games; this is not static-question accuracy.
  • Total evaluation cost in USD. It is not converted into cost per task and is not a current API quote.
  • The standard harness uses a minimal, provider-neutral interface and allows the model to keep notes.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Skill acquisition efficiency

Learning efficiency for interactive tasks. A score of 100% matches human efficiency at completing the games; this is not static-question accuracy.: showing 8 of 68 records with values. See details for configurations and dates.

Chart data · 8 entries
Name%
GPT-6 Astra (Max)62.713
GPT-6 Astra (XHigh)59.343
GPT-6 Astra (High)54.819
GPT-6.1 Sol (Max)52.729
Gemini 4 Argon (Low)49.794
Gemini 4 Argon (Medium)46.266
GPT-6.1 Sol (XHigh)39.929
GPT-6 Astra (Medium)38.588

Total run cost

Total evaluation cost in USD. It is not converted into cost per task and is not a current API quote.: showing 8 of 68 records with values. See details for configurations and dates.

Chart data · 8 entries
NameUSD
GPT-6 Luna (Low)228.833
GPT-6 Luna (None)229.771
GPT-6 Luna (Medium)241.28
GPT-6 Luna (High)255.979
GPT-6 Luna (Max)262.238
GPT-6 Luna (XHigh)262.684
Claude Haiku 5.5 (Max)388.106
DeepSeek V4.1 Flash (None)734.725

Full results & model versions

68 / 68configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

GPT-6.1 Sol (XHigh)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-1-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
39.92932040733721%
Total run cost
9104.425822 USD

Grok 4.7 (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: xAI

xai-grok-4-7 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.24696281908456538%
Total run cost
4814.88162 USD

Claude Opus 5 (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: Anthropic

anthropic-claude-opus-5 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
30.16%
Total run cost
20657.37 USD

Gemini 4 Argon (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: Google

google-gemini-4-argon · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
49.79401633943577%
Total run cost
5820.531006 USD

Grok 4.7 (XHigh)

Model reported by the benchmark

Standard framework

As reportedOrganization: xAI

xai-grok-4-7 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
1.816252653663704%
Total run cost
2731.577506 USD

GPT-6.1 Sol (Medium)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-1-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
10.568764673656196%
Total run cost
7369.782166 USD

GPT-5.6 Sol (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-5-6-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.33%
Total run cost
12805.6 USD

Claude Haiku 5.5 (Max)

Model reported by the benchmark

Standard framework

As reportedOrganization: Anthropic

anthropic-claude-haiku-5-5 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.4513711877557703%
Total run cost
388.1060053 USD