Skip to content

Commit 6eac020

Browse files
author
Maxim Saplin
committed
2 parents 868cceb + 68367da commit 6eac020

1 file changed

Lines changed: 158 additions & 0 deletions

File tree

‎data/arg-agi-apr-2026.csv‎

Lines changed: 158 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,158 @@
1+
AI SYSTEM,AUTHOR,DATE,SYSTEM TYPE,ARC-AGI-1,ARC-AGI-2,ARC-AGI-3,COST/TASK,COST (V3),CODE / PAPER
2+
GPT-5.5 Pro (High),OpenAI,23.04.2026,CoT,96.5%,84.6%,N/A,$10.51,N/A,—
3+
GPT-5.5 Pro (xHigh),OpenAI,23.04.2026,CoT,95.0%,84.2%,N/A,$10.76,N/A,—
4+
GPT-5.5 (Low),OpenAI,22.04.2026,CoT,76.2%,33.3%,N/A,$0.350,N/A,—
5+
GPT-5.5 (Medium),OpenAI,22.04.2026,CoT,92.2%,70.4%,N/A,$0.860,N/A,—
6+
GPT-5.5 (High),OpenAI,22.04.2026,CoT,94.5%,83.3%,N/A,$1.45,N/A,—
7+
GPT-5.5 (xHigh),OpenAI,22.04.2026,CoT,95.0%,85.0%,N/A,$1.87,N/A,—
8+
Claude 4.7 (Low),Anthropic,16.04.2026,CoT,91.0%,62.1%,N/A,$2.38,N/A,—
9+
Claude 4.7 (Medium),Anthropic,16.04.2026,CoT,91.0%,67.5%,N/A,$2.96,N/A,—
10+
Claude 4.7 (High),Anthropic,16.04.2026,CoT,93.5%,68.3%,N/A,$3.17,N/A,—
11+
Claude 4.7 (Max),Anthropic,16.04.2026,CoT,92.0%,75.8%,N/A,$7.43,N/A,—
12+
GPT-5.4 Mini (xHigh),OpenAI,17.03.2026,CoT,63.7%,18.9%,N/A,$0.750,N/A,—
13+
GPT-5.4 Mini (High),OpenAI,17.03.2026,CoT,58.0%,13.2%,N/A,$0.560,N/A,—
14+
GPT-5.4 Mini (Medium),OpenAI,17.03.2026,CoT,40.8%,4.4%,N/A,$0.330,N/A,—
15+
GPT-5.4 Mini (Low),OpenAI,17.03.2026,CoT,13.0%,1.1%,N/A,$0.060,N/A,—
16+
GPT-5.4 Nano (xHigh),OpenAI,17.03.2026,CoT,51.5%,5.7%,N/A,$0.160,N/A,—
17+
GPT-5.4 Nano (High),OpenAI,17.03.2026,CoT,38.2%,3.6%,N/A,$0.130,N/A,—
18+
GPT-5.4 Nano (Medium),OpenAI,17.03.2026,CoT,33.0%,1.9%,N/A,$0.060,N/A,—
19+
GPT-5.4 Nano (Low),OpenAI,17.03.2026,CoT,18.3%,1.5%,N/A,$0.010,N/A,—
20+
Grok 4.20 (Reasoning),xAI,09.03.2026,CoT,89.5%,65.1%,N/A,$0.920,N/A,—
21+
Grok 4.20 (Beta Reasoning),xAI,05.03.2026,CoT,N/A,N/A,0.1%,N/A,$3.8K,—
22+
GPT-5.4 (High),OpenAI,05.03.2026,CoT,N/A,N/A,0.2%,N/A,$5.2K,—
23+
Gemini 3.1 Pro (Preview),Google,05.03.2026,CoT,N/A,N/A,0.4%,N/A,$2.2K,—
24+
GPT-5.4 (Low),OpenAI,04.03.2026,CoT,68.2%,29.2%,N/A,$0.270,N/A,—
25+
GPT-5.4 (Medium),OpenAI,04.03.2026,CoT,86.2%,55.4%,N/A,$0.680,N/A,—
26+
GPT-5.4 (High),OpenAI,04.03.2026,CoT,92.7%,67.5%,N/A,$1.02,N/A,—
27+
GPT-5.4 (xHigh),OpenAI,04.03.2026,CoT,93.7%,74.0%,N/A,$1.52,N/A,—
28+
GPT-5.4 Pro (xHigh),OpenAI,04.03.2026,CoT,94.5%,83.3%,N/A,$16.41,N/A,—
29+
GLM-5,Z.ai,20.02.2026,CoT,44.7%,4.9%,N/A,$0.270,N/A,—
30+
Gemini 3.1 Pro (Preview),Google,19.02.2026,CoT,98.0%,77.1%,N/A,$0.962,N/A,📄
31+
Claude Sonnet 4.6 (Max),Anthropic,17.02.2026,CoT,86.0%,58.3%,N/A,$2.72,N/A,—
32+
Claude Sonnet 4.6 (High),Anthropic,17.02.2026,CoT,86.5%,60.4%,N/A,$2.70,N/A,—
33+
Gemini 3 Deep Think (Preview) ²,Google,12.02.2026,CoT,87.5%,45.1%,N/A,$77.16,N/A,—
34+
Gemini 3 Deep Think (2/26),Google,12.02.2026,CoT,96.0%,84.6%,N/A,$13.62,N/A,—
35+
Minimax M2.5,Minimax,12.02.2026,CoT,63.7%,4.9%,N/A,$0.170,N/A,—
36+
Claude Opus 4.6 (120K - Low),Anthropic,05.02.2026,CoT,86.0%,64.6%,N/A,$2.25,N/A,—
37+
Claude Opus 4.6 (120K - Medium),Anthropic,05.02.2026,CoT,92.0%,66.3%,N/A,$2.72,N/A,—
38+
Claude Opus 4.6 (120K - High),Anthropic,05.02.2026,CoT,94.0%,69.2%,N/A,$3.47,N/A,—
39+
Claude Opus 4.6 (120K - Max),Anthropic,05.02.2026,CoT,93.0%,68.8%,N/A,$3.64,N/A,—
40+
GPT-5.2 (Refine.),Johan Land,03.02.2026,Refinement,94.5%,72.9%,N/A,$38.99,N/A,💻
41+
Kimi K2.5,Moonshot AI,27.01.2026,CoT,65.3%,11.8%,N/A,$0.280,N/A,—
42+
Gemini 3 Flash Preview (Minimal),Google,17.12.2025,CoT,21.5%,3.3%,N/A,$0.021,N/A,—
43+
Gemini 3 Flash Preview (Low),Google,17.12.2025,CoT,29.0%,1.3%,N/A,$0.025,N/A,—
44+
Gemini 3 Flash Preview (Medium),Google,17.12.2025,CoT,57.7%,12.8%,N/A,$0.082,N/A,—
45+
Gemini 3 Flash Preview (High),Google,17.12.2025,CoT,84.7%,33.6%,N/A,$0.231,N/A,—
46+
Anthropic Opus 4.6 (Max),Anthropic,17.12.2025,CoT,N/A,N/A,0.5%,N/A,$8.9K,—
47+
GPT-5.2,OpenAI,11.12.2025,Base LLM,12.3%,0.8%,N/A,$0.082,N/A,—
48+
GPT-5.2 (Low),OpenAI,11.12.2025,CoT,55.7%,9.7%,N/A,$0.264,N/A,—
49+
GPT-5.2 (Medium),OpenAI,11.12.2025,CoT,72.7%,26.7%,N/A,$0.759,N/A,—
50+
GPT-5.2 (High),OpenAI,11.12.2025,CoT,78.7%,43.3%,N/A,$1.39,N/A,—
51+
GPT-5.2 (xHigh),OpenAI,11.12.2025,CoT,86.2%,52.9%,N/A,$1.90,N/A,—
52+
GPT-5.2 Pro (Medium),OpenAI,11.12.2025,CoT,81.2%,38.5%,N/A,$8.99,N/A,—
53+
GPT-5.2 Pro (High),OpenAI,11.12.2025,CoT,85.7%,54.2%,N/A,$15.72,N/A,—
54+
GPT-5.2 Pro (xHigh),OpenAI,11.12.2025,CoT,90.5%,N/A,N/A,$11.65,N/A,—
55+
Gemini 3 Pro (Refine.),Poetiq,04.12.2025,Refinement,N/A,54.0%,N/A,$30.57,N/A,—
56+
Deepseek V3.2,Deepseek,01.12.2025,Base LLM,57.0%,4.0%,N/A,$0.120,N/A,—
57+
Opus 4.5 (Thinking - None),Anthropic,24.11.2025,CoT,40.0%,7.8%,N/A,$0.220,N/A,—
58+
Opus 4.5 (Thinking - 1K),Anthropic,24.11.2025,CoT,35.2%,9.4%,N/A,$0.230,N/A,—
59+
Opus 4.5 (Thinking - 8K),Anthropic,24.11.2025,CoT,58.7%,13.9%,N/A,$0.480,N/A,—
60+
Opus 4.5 (Thinking - 16K),Anthropic,24.11.2025,CoT,72.0%,22.8%,N/A,$0.790,N/A,—
61+
Opus 4.5 (Thinking - 32K),Anthropic,24.11.2025,CoT,75.8%,30.6%,N/A,$1.29,N/A,—
62+
Opus 4.5 (Thinking - 64K),Anthropic,24.11.2025,CoT,80.0%,37.6%,N/A,$2.40,N/A,—
63+
Gemini 3 Pro,Google,18.11.2025,CoT,75.0%,31.1%,N/A,$0.811,N/A,—
64+
GPT-5.1 (Thinking - None),OpenAI,13.11.2025,CoT,5.8%,0.4%,N/A,$0.058,N/A,—
65+
GPT-5.1 (Thinking - Low),OpenAI,13.11.2025,CoT,33.2%,1.9%,N/A,$0.129,N/A,—
66+
GPT-5.1 (Thinking - Medium),OpenAI,13.11.2025,CoT,57.7%,6.5%,N/A,$0.421,N/A,—
67+
GPT-5.1 (Thinking - High),OpenAI,13.11.2025,CoT,72.8%,17.6%,N/A,$1.17,N/A,—
68+
Grok 4 (Fast Reasoning),xAI,21.10.2025,CoT,48.5%,5.3%,N/A,$0.061,N/A,📄
69+
Tiny Recursion Model (TRM),Bespoke,07.10.2025,N/A,40.0%,6.3%,N/A,$2.10,N/A,📄💻
70+
GPT-5 Pro,OpenAI,06.10.2025,CoT,70.2%,18.3%,N/A,$7.14,N/A,📄
71+
Claude Haiku 4.5,Anthropic,01.10.2025,Base LLM,14.3%,1.3%,N/A,$0.043,N/A,📄
72+
Claude Haiku 4.5 (Thinking 1K),Anthropic,01.10.2025,CoT,16.8%,1.3%,N/A,$0.047,N/A,📄
73+
Claude Haiku 4.5 (Thinking 8K),Anthropic,01.10.2025,CoT,25.5%,1.7%,N/A,$0.091,N/A,📄
74+
Claude Haiku 4.5 (Thinking 16K),Anthropic,01.10.2025,CoT,37.3%,2.8%,N/A,$0.139,N/A,📄
75+
Claude Haiku 4.5 (Thinking 32K),Anthropic,01.10.2025,CoT,47.7%,4.0%,N/A,$0.377,N/A,📄
76+
Claude Sonnet 4.5,Anthropic,29.09.2025,Base LLM,25.5%,3.8%,N/A,$0.130,N/A,📄
77+
Claude Sonnet 4.5 (Thinking 1K),Anthropic,29.09.2025,CoT,31.0%,5.8%,N/A,$0.142,N/A,📄
78+
Claude Sonnet 4.5 (Thinking 8K),Anthropic,29.09.2025,CoT,46.5%,6.9%,N/A,$0.235,N/A,📄
79+
Claude Sonnet 4.5 (Thinking 16K),Anthropic,29.09.2025,CoT,48.3%,6.9%,N/A,$0.350,N/A,📄
80+
Claude Sonnet 4.5 (Thinking 32K),Anthropic,29.09.2025,CoT,63.7%,13.6%,N/A,$0.759,N/A,📄
81+
GPT-5 (High),OpenAI,07.08.2025,CoT,65.7%,9.9%,N/A,$0.730,N/A,—
82+
GPT-5 (Medium),OpenAI,07.08.2025,CoT,56.2%,7.5%,N/A,$0.449,N/A,—
83+
GPT-5 (Low),OpenAI,07.08.2025,CoT,44.0%,1.9%,N/A,$0.190,N/A,—
84+
GPT-5 (Minimal),OpenAI,07.08.2025,Base LLM,6.0%,0.0%,N/A,$0.056,N/A,—
85+
GPT-5 Mini (High),OpenAI,07.08.2025,CoT,54.3%,4.4%,N/A,$0.198,N/A,—
86+
GPT-5 Mini (Medium),OpenAI,07.08.2025,CoT,37.3%,4.0%,N/A,$0.063,N/A,—
87+
GPT-5 Mini (Low),OpenAI,07.08.2025,CoT,26.3%,0.8%,N/A,$0.019,N/A,—
88+
GPT-5 Mini (Minimal),OpenAI,07.08.2025,CoT,5.3%,1.7%,N/A,$0.009,N/A,—
89+
GPT-5 Nano (High),OpenAI,07.08.2025,CoT,16.7%,2.6%,N/A,$0.029,N/A,—
90+
GPT-5 Nano (Medium),OpenAI,07.08.2025,CoT,20.7%,0.9%,N/A,$0.014,N/A,—
91+
GPT-5 Nano (Low),OpenAI,07.08.2025,CoT,4.0%,0.0%,N/A,$0.003,N/A,—
92+
GPT-5 Nano (Minimal),OpenAI,07.08.2025,CoT,1.5%,0.0%,N/A,$0.003,N/A,—
93+
Hierarchical Reasoning Model (HRM),Bespoke,07.08.2025,N/A,32.0%,2.0%,N/A,$1.68,N/A,—
94+
Grok 4 (Refine.),J. Berman,07.08.2025,Refinement,79.6%,29.4%,N/A,$30.40,N/A,💻
95+
Grok 4 (Refine.),E. Pang,07.08.2025,Refinement,77.1%,26.0%,N/A,$3.97,N/A,💻
96+
Qwen3-235b-a22b Instruct (25/07),Alibaba,25.07.2025,Base LLM,11.0%,1.3%,N/A,$0.004,N/A,📄
97+
Grok 4 (Thinking),xAI,09.07.2025,CoT,66.7%,16.0%,N/A,$2.17,N/A,📄
98+
Gemini 2.5 Pro (Thinking 1K),Google,17.06.2025,CoT,16.0%,0.0%,N/A,$0.088,N/A,📄
99+
Gemini 2.5 Pro (Thinking 8K),Google,17.06.2025,CoT,29.5%,2.9%,N/A,$0.444,N/A,📄
100+
Gemini 2.5 Pro (Thinking 16K),Google,17.06.2025,CoT,41.0%,4.0%,N/A,$0.715,N/A,📄
101+
Gemini 2.5 Pro (Thinking 32K),Google,17.06.2025,CoT,37.0%,4.9%,N/A,$0.757,N/A,📄
102+
o3-Pro (Low),OpenAI,10.06.2025,CoT + Synthesis,44.3%,2.1%,N/A,$2.23,N/A,📄
103+
o3-Pro (Medium),OpenAI,10.06.2025,CoT + Synthesis,57.0%,1.9%,N/A,$4.74,N/A,📄
104+
o3-Pro (High),OpenAI,10.06.2025,CoT + Synthesis,59.3%,4.9%,N/A,$7.55,N/A,📄
105+
Magistral Small,Mistral,10.06.2025,CoT,5.0%,0.0%,N/A,$0.049,N/A,📄
106+
Magistral Medium,Mistral,10.06.2025,CoT,5.9%,0.0%,N/A,$0.108,N/A,📄
107+
Magistral Medium (Thinking),Mistral,10.06.2025,CoT,6.1%,0.0%,N/A,$0.123,N/A,📄
108+
Deepseek R1 (05/28),Deepseek,28.05.2025,CoT,21.2%,1.1%,N/A,$0.053,N/A,📄
109+
Codex Mini (Latest),OpenAI,23.05.2025,CoT,27.3%,1.3%,N/A,$0.230,N/A,📄
110+
Gemini 2.5 Flash (Preview),Google,20.05.2025,CoT,33.3%,1.7%,N/A,$0.057,N/A,📄💻
111+
Gemini 2.5 Flash (Preview) (Thinking 1K),Google,20.05.2025,CoT,16.0%,2.2%,N/A,$0.030,N/A,📄💻
112+
Gemini 2.5 Flash (Preview) (Thinking 8K),Google,20.05.2025,CoT,25.8%,2.1%,N/A,$0.199,N/A,📄💻
113+
Gemini 2.5 Flash (Preview) (Thinking 16K),Google,20.05.2025,CoT,33.3%,2.0%,N/A,$0.317,N/A,📄💻
114+
Gemini 2.5 Flash (Preview) (Thinking 24K),Google,20.05.2025,CoT,32.3%,2.5%,N/A,$0.319,N/A,📄💻
115+
Claude Sonnet 4,Anthropic,14.05.2025,Base LLM,23.8%,1.3%,N/A,$0.127,N/A,📄
116+
Claude Sonnet 4 (Thinking 1K),Anthropic,14.05.2025,CoT,28.0%,0.9%,N/A,$0.142,N/A,📄
117+
Claude Sonnet 4 (Thinking 8K),Anthropic,14.05.2025,CoT,29.0%,2.1%,N/A,$0.265,N/A,📄
118+
Claude Sonnet 4 (Thinking 16K),Anthropic,14.05.2025,CoT,40.0%,5.9%,N/A,$0.486,N/A,📄
119+
Claude Opus 4 (Thinking 16K),Anthropic,14.05.2025,CoT,35.7%,8.6%,N/A,$1.93,N/A,📄
120+
Claude Opus 4 (Thinking 8K),Anthropic,14.05.2025,CoT,30.7%,4.5%,N/A,$1.16,N/A,📄
121+
Claude Opus 4 (Thinking 1K),Anthropic,14.05.2025,CoT,27.0%,0.0%,N/A,$0.750,N/A,📄
122+
Claude Opus 4,Anthropic,14.05.2025,CoT,22.5%,1.3%,N/A,$0.639,N/A,📄
123+
o3 (Low),OpenAI,16.04.2025,CoT,41.5%,2.0%,N/A,$0.234,N/A,—
124+
o3 (Medium),OpenAI,16.04.2025,CoT,53.8%,3.0%,N/A,$0.479,N/A,—
125+
o3 (High),OpenAI,16.04.2025,CoT,60.8%,6.5%,N/A,$0.834,N/A,—
126+
o4-mini (Low),OpenAI,16.04.2025,CoT,21.3%,1.7%,N/A,$0.050,N/A,—
127+
o4-mini (Medium),OpenAI,16.04.2025,CoT,41.8%,2.4%,N/A,$0.231,N/A,—
128+
o4-mini (High),OpenAI,16.04.2025,CoT,58.7%,6.1%,N/A,$0.856,N/A,—
129+
GPT-4.1-Nano,OpenAI,14.04.2025,Base LLM,0.0%,0.0%,N/A,$0.004,N/A,📄💻
130+
GPT-4.1-Mini,OpenAI,14.04.2025,Base LLM,3.5%,0.0%,N/A,$0.014,N/A,📄💻
131+
GPT-4.1,OpenAI,14.04.2025,Base LLM,5.5%,0.4%,N/A,$0.069,N/A,📄💻
132+
Llama 4 Maverick,Meta,05.04.2025,Base LLM,4.4%,0.0%,N/A,$0.012,N/A,📄💻
133+
Llama 4 Scout,Meta,05.04.2025,Base LLM,0.5%,0.0%,N/A,$0.006,N/A,📄💻
134+
GPT-4.5,OpenAI,27.02.2025,Base LLM,10.3%,0.8%,N/A,$2.10,N/A,💻
135+
Claude 3.7,Anthropic,24.02.2025,Base LLM,13.6%,0.0%,N/A,$0.120,N/A,💻
136+
Claude 3.7 (16K),Anthropic,24.02.2025,CoT,28.6%,0.7%,N/A,$0.510,N/A,💻
137+
Claude 3.7 (1K),Anthropic,24.02.2025,CoT,11.6%,0.4%,N/A,$0.140,N/A,💻
138+
Claude 3.7 (8K),Anthropic,24.02.2025,CoT,21.2%,0.9%,N/A,$0.360,N/A,💻
139+
Grok 3,xAI,19.02.2025,Base LLM,5.5%,0.0%,N/A,$0.142,N/A,📄
140+
Grok 3 Mini (Low),xAI,19.02.2025,CoT,16.5%,0.4%,N/A,$0.013,N/A,📄
141+
Gemini 2.5 Pro (Preview),Google,19.02.2025,CoT,33.0%,3.8%,N/A,$0.813,N/A,📄
142+
Gemini 2.5 Pro (Preview - Thinking 1K),Google,19.02.2025,CoT,31.3%,3.4%,N/A,$0.804,N/A,📄
143+
Gemini 1.5 Pro,Google,15.02.2025,Base LLM,N/A,0.8%,N/A,$0.040,N/A,💻
144+
Gemini 2.0 Flash,Google,02.02.2025,Base LLM,N/A,1.3%,N/A,$0.004,N/A,💻
145+
o3-mini (Low),OpenAI,31.01.2025,CoT,14.5%,0.0%,N/A,$0.062,N/A,—
146+
o3-mini (Medium),OpenAI,31.01.2025,CoT,22.3%,2.1%,N/A,$0.284,N/A,—
147+
o3-mini (High),OpenAI,31.01.2025,CoT,34.5%,3.0%,N/A,$0.547,N/A,—
148+
Deepseek R1,Deepseek,22.01.2025,CoT,15.8%,1.3%,N/A,$0.080,N/A,💻
149+
o3 (Preview - Low) ¹,OpenAI,20.12.2024,CoT + Synthesis,75.7%,4.0%,N/A,$200.00,N/A,📄
150+
GPT-4o,OpenAI,20.11.2024,Base LLM,4.5%,0.0%,N/A,$0.080,N/A,💻
151+
ARChitects,ARC Prize 2024,03.11.2024,Custom,56.0%,2.5%,N/A,$0.200,N/A,📄💻
152+
NVARC,ARC Prize 2025,03.11.2024,Custom,N/A,27.6%,N/A,$0.200,N/A,📄💻
153+
o1-mini,OpenAI,12.09.2024,CoT,14.0%,0.8%,N/A,$0.191,N/A,📄💻
154+
GPT-4o-mini,OpenAI,18.07.2024,Base LLM,N/A,0.0%,N/A,$0.010,N/A,💻
155+
Icecuber,ARC Prize 2024,03.11.2023,Custom,17.0%,1.6%,N/A,$0.130,N/A,💻
156+
Human Panel,Human,N/A,N/A,98.0%,100.0%,N/A,$17.00,N/A,—
157+
Avg. Mturker,Human,N/A,N/A,77.0%,N/A,N/A,$3.00,N/A,—
158+
Stem Grad,Human,N/A,N/A,98.0%,N/A,N/A,$10.00,N/A,—

0 commit comments

Comments
 (0)