# ARC-AGI 排行榜：从被动智力测试演进到实时适应新环境的 AI 评估

- 来源：Hacker News 热门（buzzing.cc 中文翻译）
- 作者：rzk
- 发布时间：2026-07-25 19:54
- AIHOT 分数：26
- AIHOT 链接：https://aihot.virxact.com/items/cms0cd659018grodzgpkqh2sp
- 原文链接：https://arcprize.org/leaderboard

## AI 摘要

ARC-AGI 已从测量被动流体智力的早期版本演进到 ARC-AGI-3，要求 AI 智能体实时适应新型交互环境。散点图揭示了每任务成本与性能的关系：推理系统增加推理时间可带来渐近性能提升，而基础 LLM（如 GPT-4.5、Claude 3.7）的单次推理点代表无扩展推理的原始性能。

## 正文

Understanding the Leaderboard

ARC-AGI has evolved from its first versions (ARC-AGI-1 and 2) which measured passive fluid intelligence, to ARC-AGI-3 which challenges AI agents to adapt on the fly to novel interactive environments.

The scatter plot above visualizes the critical relationship between cost-per-task and performance - a key measure of efficiency. True intelligence isn't just about solving problems, but solving them efficiently with minimal resources.

Interpreting the data

Reasoning Systems Trend Line solutions display connected points representing the same model at different reasoning levels. These trend lines illustrate how increased reasoning time affects performance, typically showing asymptotic behavior as thinking time increases.

Base LLMs solutions represent single-shot inference from standard language models like GPT-4.5 and Claude 3.7, without extended reasoning capabilities. These points demonstrate raw model performance without additional reasoning enhancements.

Kaggle Systems solutions showcase competition-grade submissions from the Kaggle challenge, operating under strict computational constraints ($50 compute budget for 120 evaluation tasks). These represent purpose-built, efficient methods specifically designed for the ARC Prize.

Verification Policy

For more information, see our testing policy.

Leaderboard Breakdown

Notes

Only systems which required less than $10,000 to run are shown.

For models that were not able to produce full test out puts, remaining tasks were marked as incorrect.

Results marked as "preview" are unofficial and may be based on incomplete testing.

1 ARC-AGI-2 score estimate based on partial testing results and o1-pro pricing.

2 Provisional cost estimates based on Gemini 3 Pro pricing. Model to be retested once released.
