Project benchmark

ARC-AGI-3 · standard framework

ARC Prize · 64 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-19· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Run configurations remain separate, including different reasoning settings.
  • Individual test dates are not given. Update dates and model release dates from the report remain separate and do not substitute for actual test dates.
  • Costs follow the report’s run scope and dollar amounts; they are not model API unit prices.
  • ARC-AGI-3 · Semi-private evaluation set. Benchmark versions are compared separately.
  • Learning efficiency for interactive tasks. A score of 100% matches human efficiency at completing the games; this is not static-question accuracy.
  • Total evaluation cost in USD. It is not converted into cost per task and is not a current API quote.
  • The standard harness uses a minimal, provider-neutral interface and allows the model to keep notes.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Skill acquisition efficiency

Learning efficiency for interactive tasks. A score of 100% matches human efficiency at completing the games; this is not static-question accuracy.: showing 8 of 64 records with values. See details for configurations and dates.

Chart data · 8 entries
Name%
GPT-6 Astra (Max)62.713
GPT-6 Astra (XHigh)59.343
GPT-6 Astra (High)54.819
GPT-6.1 Sol (Max)52.729
Gemini 4 Argon (Low)49.794
Gemini 4 Argon (Medium)46.266
GPT-6.1 Sol (XHigh)39.929
GPT-6 Astra (Medium)38.588

Total run cost

Total evaluation cost in USD. It is not converted into cost per task and is not a current API quote.: showing 8 of 64 records with values. See details for configurations and dates.

Chart data · 8 entries
NameUSD
GPT-6 Luna (Low)228.833
GPT-6 Luna (None)229.771
GPT-6 Luna (Medium)241.28
GPT-6 Luna (High)255.979
GPT-6 Luna (Max)262.238
GPT-6 Luna (XHigh)262.684
Claude Haiku 5.5 (Max)388.106
DeepSeek V4.1 Flash (None)734.725

Full results & model versions

64 / 64configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

GPT-6 Sol (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.899438991115236%
Total run cost
5072.447082 USD

DeepSeek V4.1 Flash (None)

Model reported by the benchmark

Standard framework

As reportedOrganization: DeepSeek

deepseek-v4-1-flash · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.3431694493873915%
Total run cost
734.7252066 USD

GPT-6 Luna (Medium)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-luna · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.1941528463935471%
Total run cost
241.2797313 USD

GPT-6 Sol (None)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.2837742350643006%
Total run cost
4655.549962 USD

GPT-6 Astra (None)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-astra · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
35.177880317424%
Total run cost
49791.11317000001 USD

GPT-6 Astra (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-astra · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
54.81905163612231%
Total run cost
40704.722830000006 USD

Grok 4.5 (Medium)

Model reported by the benchmark

Standard framework

As reportedOrganization: xAI

xai-grok-4-5 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.32%
Total run cost
8458.3 USD

GPT-5.6 Luna (Medium)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-5-6-luna · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.17%
Total run cost
2379.13 USD

GPT-6 Sol (XHigh)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
1.7976269602783517%
Total run cost
5105.623836 USD

GPT-5.6 Luna (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-5-6-luna · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.17%
Total run cost
2307.49 USD

GPT-6 Astra (XHigh)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-astra · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
59.34295409146055%
Total run cost
37317.38768 USD

GPT-5.4 (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-5-4-2026-03-05-thinking · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.21%
Total run cost
5187.41 USD

GPT-6 Sol (Medium)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.418612306617149%
Total run cost
4863.795116 USD

GPT-5.5 (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-5-5-2026-04-23-thinking · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.43%
Total run cost
10000 USD

DeepSeek V4.1 Flash (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: DeepSeek

deepseek-v4-1-flash · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.34514247315937174%
Total run cost
820.6333452 USD

Gemini 3.1 Pro (Preview)

Model reported by the benchmark

Standard framework

As reportedOrganization: Google

google-gemini-3-1-pro-preview · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.42%
Total run cost
2213.53 USD

GPT-6.1 Sol (XHigh)

Model reported by the benchmark

Standard framework

As reportedOrganization: OpenAI

openai-gpt-6-1-sol · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
39.92932040733721%
Total run cost
9104.425822 USD

Grok 4.7 (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: xAI

xai-grok-4-7 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
0.24696281908456538%
Total run cost
4814.88162 USD

Claude Opus 5 (High)

Model reported by the benchmark

Standard framework

As reportedOrganization: Anthropic

anthropic-claude-opus-5 · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
30.16%
Total run cost
20657.37 USD

Gemini 4 Argon (Low)

Model reported by the benchmark

Standard framework

As reportedOrganization: Google

google-gemini-4-argon · CoT

Release time reported by the benchmark:

Skill acquisition efficiency
49.79401633943577%
Total run cost
5820.531006 USD