Find the right AI for you

Search by name or tell us what you want to do
API servicesChoose how to access modelsAI modelsCapabilities, specifications, and pricingAI toolsFind useful tools by taskMCP directoryConnect tools, data, and workflowsAgent skillsFind reusable skills for AI agentsBenchmarksCompare model performanceOnline toolsConvert accounts, format JSON, estimate costs and test APIsModel timelineExplore model releasesUse casesStart with a practical task
EnterSearch · ↑↓Choose a resultEscClose
Submit中文
Project benchmark

ARC-AGI-1 · Abstract reasoning

ARC Prize · 289 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-11-03· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Run configurations remain separate, including different reasoning settings.
  • Individual test dates are not given. Update dates and model release dates from the report remain separate and do not substitute for actual test dates.
  • Costs follow the report’s run scope and dollar amounts; they are not model API unit prices.
  • ARC-AGI-1 · Semi-private evaluation set. Benchmark versions are compared separately.
  • Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.
  • Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.
  • Human reference results are shown separately and excluded from model/system rankings and cost comparisons.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Task score

Task score on the semi-private evaluation set, as a percentage. It is not ranked across benchmark versions or evaluation scopes.: showing 8 of 289 records with values. See details for configurations and dates.

Chart data · 8 entries
Name%
Claude Fable 5 (Max)98.5
Claude Fable 5 (XHigh)98.5
Claude Opus 5.5 (High)98.5
Gemini 3.8 Flash (High)98.5
Gemini 4 Argon (High)98.5
Gemini 4 Argon (Medium)98.5
GPT-6 Astra (High)98.5
GPT-6 Astra (XHigh)98.5

Cost per task

Cost per task as reported, in USD/task. Total costs and task counts are not invented. This is neither cost per successful task nor a current API quote.: showing 8 of 289 records with values. See details for configurations and dates.

Chart data · 8 entries
NameUSD / Task
GPT-5 Nano (Minimal)0.002
GPT-4.1-Nano0.002
GPT-6 Luna (None)0.002
DeepSeek V4 Flash 0731 (None)0.002
Qwen3-235b-a22b Instruct (25/07)0.003
GPT-6 Luna (Low)0.003
GPT-5 Nano (Low)0.003
Nemotron 3.5 Super VL (None)0.004

Human reference

Human baselines are shown separately and are not ranked alongside models and systems.

Stem Grad

Task score
98%
Cost per task
10 USD / Task

Human Panel

Task score
98%
Cost per task
17 USD / Task

Full results & model versions

289 / 289configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

GPT-5 Mini (Medium)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-mini-reasoning · CoT

Release time reported by the benchmark:

Task score
37.33%
Cost per task
0.0401 USD / Task

Qwen3.8-27B (None)

Model reported by the benchmark

As reportedOrganization: Alibaba

alibaba-qwen3-8-27b · CoT

Release time reported by the benchmark:

Task score
34%
Cost per task
0.041255 USD / Task

DeepSeek V4 Flash 0731 (None)

Model reported by the benchmark

As reportedOrganization: DeepSeek

deepseek-v4-flash-0731 · CoT

Release time reported by the benchmark:

Task score
11.833333333333336%
Cost per task
0.002331 USD / Task

Grok 4.6 (XHigh)

Model reported by the benchmark

As reportedOrganization: xAI

xai-grok-4-6 · CoT

Release time reported by the benchmark:

Task score
87%
Cost per task
0.348182 USD / Task

Gemini 3 Flash Preview (Medium)

Model reported by the benchmark

As reportedOrganization: Google

gemini-3-flash-preview-thinking · CoT

Release time reported by the benchmark:

Task score
57.67%
Cost per task
0.0612 USD / Task

Beam 1.0 (Medium)

Model reported by the benchmark

As reportedOrganization: Reflection

reflection-beam-1-0 · CoT

Release time reported by the benchmark:

Task score
55.66666666666666%
Cost per task
0.124348 USD / Task

Inkling Small (High)

Model reported by the benchmark

As reportedOrganization: Thinking Machines

thinky-inkling-small · CoT

Release time reported by the benchmark:

Task score
78%
Cost per task
0.066856 USD / Task

Gemini 2.5 Pro (Thinking 16K)

Model reported by the benchmark

As reportedOrganization: Google

gemini-2-5-pro-2025-06-17-thinking · CoT

Release time reported by the benchmark:

Task score
41%
Cost per task
0.4839 USD / Task

Gemini 3.5 Flash (Minimal)

Model reported by the benchmark

As reportedOrganization: Google

gemini-3-5-flash · CoT

Release time reported by the benchmark:

Task score
48.83%
Cost per task
0.0645 USD / Task

GPT-5 Mini (Low)

Model reported by the benchmark

As reportedOrganization: OpenAI

gpt-5-mini-reasoning · CoT

Release time reported by the benchmark:

Task score
26.33%
Cost per task
0.0135 USD / Task

Gemini 3.5 Flash-Lite (Minimal)

Model reported by the benchmark

As reportedOrganization: Google

gemini-3-5-flash-lite · CoT

Release time reported by the benchmark:

Task score
7.5%
Cost per task
0.008311 USD / Task

DeepSeek V4.1 Flash 1017 (Low)

Model reported by the benchmark

As reportedOrganization: DeepSeek

deepseek-v4-1-flash-1017 · CoT

Release time reported by the benchmark:

Task score
91.5%
Cost per task
0.050427 USD / Task

Claude Haiku 5.5 (Max)

Model reported by the benchmark

As reportedOrganization: Anthropic

anthropic-claude-haiku-5-5 · CoT

Release time reported by the benchmark:

Task score
89%
Cost per task
0.051328 USD / Task

Inkling Small (XHigh)

Model reported by the benchmark

As reportedOrganization: Thinking Machines

thinky-inkling-small · CoT

Release time reported by the benchmark:

Task score
84%
Cost per task
0.114982 USD / Task

Opus 4.5 (Thinking, 64K)

Model reported by the benchmark

As reportedOrganization: Anthropic

opus-4-5-thinking · CoT

Release time reported by the benchmark:

Task score
80%
Cost per task
1.47 USD / Task

Gemini 4 Argon (Medium)

Model reported by the benchmark

As reportedOrganization: Google

google-gemini-4-argon · CoT

Release time reported by the benchmark:

Task score
98.5%
Cost per task
0.06468 USD / Task

GLM-5.3-Flash (High)

Model reported by the benchmark

As reportedOrganization: Z.ai

zai-glm-5-3-flash · CoT

Release time reported by the benchmark:

Task score
71.83333333333334%
Cost per task
0.027895 USD / Task

Inkling Small (Minimal)

Model reported by the benchmark

As reportedOrganization: Thinking Machines

thinky-inkling-small · CoT

Release time reported by the benchmark:

Task score
48.5%
Cost per task
0.0237 USD / Task

Qwen3.8-27B (Medium)

Model reported by the benchmark

As reportedOrganization: Alibaba

alibaba-qwen3-8-27b · CoT

Release time reported by the benchmark:

Task score
68.66666666666664%
Cost per task
0.130815 USD / Task

Grok 4 (Fast Reasoning)

Model reported by the benchmark

As reportedOrganization: xAI

grok-4-0709 · CoT

Release time reported by the benchmark:

Task score
48.5%
Cost per task
0.0307 USD / Task