Find the right AI for you

Search by name or tell us what you want to do
API servicesChoose how to access modelsAI modelsCapabilities, specifications, and pricingAI toolsFind useful tools by taskMCP directoryConnect tools, data, and workflowsAgent skillsFind reusable skills for AI agentsBenchmarksCompare model performanceOnline toolsConvert accounts, format JSON, estimate costs and test APIsModel timelineExplore model releasesUse casesStart with a practical task
EnterSearch · ↑↓Choose a resultEscClose
Submit中文
Project benchmark

ARC-AGI-2 · Abstract reasoning

ARC Prize · 290 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-11-03· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Run configurations remain separate, including different reasoning settings.
  • Individual test dates are not given. Update dates and model release dates from the report remain separate and do not substitute for actual test dates.
  • Costs follow the report’s run scope and dollar amounts; they are not model API unit prices.
  • ARC-AGI-2 · Semi-private evaluation set. Benchmark versions are compared separately.
  • Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.
  • Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.
  • Human reference results are shown separately and excluded from model/system rankings and cost comparisons.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Task score

Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.: showing 8 of 290 records with values. See details for configurations and dates.

Chart data · 8 entries
Name%
GPT-6 Astra (Max)95
GPT-6.1 Sol (Max)94.167
Claude Opus 5.5 (High)93.333
GPT-6 Astra (XHigh)93.333
Claude Opus 5.5 (XHigh)92.5
GPT-5.6 Sol (Max)92.5
GPT-6 Astra (High)92.083
GPT-6 Astra (Medium)92.083

Cost per task

Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.: showing 8 of 290 records with values. See details for configurations and dates.

Chart data · 8 entries
NameUSD / Task
GPT-5 Nano (Minimal)0.003
GPT-5 Nano (Low)0.003
GPT-4.1-Nano0.004
GPT-6 Luna (None)0.004
DeepSeek V4 Flash 0731 (None)0.004
Gemini 2.0 Flash0.004
Qwen3-235b-a22b Instruct (25/07)0.004
GPT-6 Luna (Low)0.005

Human reference

Human baselines are shown separately and are not ranked alongside models and systems.

Human Panel

Task score
100%
Cost per task
17 USD / Task

Full results & model versions

290 / 290configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

Qwen3.8-27B (None)

Model reported by the benchmark

As reportedOrganization: Alibaba

alibaba-qwen3-8-27b · CoT

Release time reported by the benchmark:

Task score
1.5277777777777777%
Cost per task
0.058919 USD / Task

Grok 4.7 (Low)

Model reported by the benchmark

As reportedOrganization: xAI

xai-grok-4-7 · CoT

Release time reported by the benchmark:

Task score
16.666666666666664%
Cost per task
0.173698 USD / Task

Grok 4 (Fast Reasoning)

Model reported by the benchmark

As reportedOrganization: xAI

grok-4-0709 · CoT

Release time reported by the benchmark:

Task score
5.28%
Cost per task
0.061 USD / Task

GPT-5.6 Luna 2026-07-30 (Low)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-luna-2026-07-30 · CoT

Release time reported by the benchmark:

Task score
3.611111111111111%
Cost per task
0.01363 USD / Task

DeepSeek V4 Pro 0813 (High)

Model reported by the benchmark

As reportedOrganization: DeepSeek

deepseek-v4-pro-0813 · CoT

Release time reported by the benchmark:

Task score
59.72222222222221%
Cost per task
0.596943 USD / Task

GPT-6 Sol (Medium)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-sol · CoT

Release time reported by the benchmark:

Task score
57.77777777777778%
Cost per task
0.147627 USD / Task

Dots3-Note Preview (Max)

Model reported by the benchmark

As reportedOrganization: Dots Studio

dots-studio-dots3-note-prev-max · CoT

Release time reported by the benchmark:

Task score
76.80555555555556%
Cost per task
0.076656 USD / Task

GPT-6 Luna (High)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-luna · CoT

Release time reported by the benchmark:

Task score
31.38888888888889%
Cost per task
0.023362 USD / Task

GPT-6 Luna (Medium)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-luna · CoT

Release time reported by the benchmark:

Task score
18.055555555555554%
Cost per task
0.012203 USD / Task

DeepSeek V4 Pro 0813 (None)

Model reported by the benchmark

As reportedOrganization: DeepSeek

deepseek-v4-pro-0813 · CoT

Release time reported by the benchmark:

Task score
0.8333333333333333%
Cost per task
0.040292 USD / Task

GPT-5.6 Terra (High)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-terra · CoT

Release time reported by the benchmark:

Task score
67.08%
Cost per task
0.55 USD / Task

GPT-6 Astra (Max)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-6-astra · CoT

Release time reported by the benchmark:

Task score
95%
Cost per task
1.119468 USD / Task

Claude Sonnet 4.6 (High)

Model reported by the benchmark

As reportedOrganization: Anthropic

claude-sonnet-4-6 · CoT

Release time reported by the benchmark:

Task score
60.42%
Cost per task
2.6966 USD / Task

Grok 4.7 (High)

Model reported by the benchmark

As reportedOrganization: xAI

xai-grok-4-7 · CoT

Release time reported by the benchmark:

Task score
58.33333333333334%
Cost per task
1.549013 USD / Task

Claude Sonnet 4 (Thinking 1K)

Model reported by the benchmark

As reportedOrganization: Anthropic

claude-sonnet-4-20250514-thinking · CoT

Release time reported by the benchmark:

Task score
0.85%
Cost per task
0.1425 USD / Task

Grok 4.5 (Medium)

Model reported by the benchmark

As reportedOrganization: xAI

xai-grok-4-5 · CoT

Release time reported by the benchmark:

Task score
52.64%
Cost per task
0.75 USD / Task

Gemini 2.5 Flash (Preview)

Model reported by the benchmark

As reportedOrganization: Google

CoT

Release time reported by the benchmark:

Task score
1.69%
Cost per task
0.057 USD / Task

Claude 3.7 (1K)

Model reported by the benchmark

As reportedOrganization: Anthropic

Claude_3_7_thinking · CoT

Release time reported by the benchmark:

Task score
0.4%
Cost per task
0.14 USD / Task

GPT-5.6 Terra (XHigh)

Model reported by the benchmark

As reportedOrganization: OpenAI

openai-gpt-5-6-terra · CoT

Release time reported by the benchmark:

Task score
74.17%
Cost per task
0.69 USD / Task

GPT-5.2 Pro (High)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-2-pro-2025-12-11-thinking · CoT

Release time reported by the benchmark:

Task score
54.16%
Cost per task
15.721 USD / Task