Rohan Paul@rohanpaul_ai

2026-07-06 04:50·2天前

AI 摘要

CAIS和Scale发布Remote Labor Index新结果：Fable 5可自动化16.1%的真实远程工作项目（约2倍于Opus 4.8的8.3%），GPT-5.5仅6.3%。测试任务包含CAD、建筑、动画、音频、数据分析、Web应用等复杂真实工作，而非简单文本问答。Fable 5在环形建模、动画、浴室设计上表现最强，但自动评判器高估GPT-5.5约2.9倍、Opus 4.8约2.3倍，质量控制仍是瓶颈。进步来自更强的智能体架构：更好的工具使用、完整桌面环境、专业软件、更长运行时间及“工人-批评者”循环。AI收入增长比移动/互联网快3倍，价值单位正从注意力转向完成的工作。

CAIS and Scale （AI safety research group） say Fable 5 now automates 16.1% of real remote-work projects， about 2x Opus 4.8.

Remote Labor Index tests whether an AI can finish paid freelance work well enough for a client to accept it.

Each task comes with briefs， files， and a professional deliverable used as the human baseline.

Fable 5 led the new results， while Opus 4.8 reached 8.3% and GPT-5.5 reached 6.3%.

That 16.1% number still means failure on most tasks， but the direction of improvement is massive. For the context of how large this jump is， the best model scored only 2.5% when RLI launched.

The work is not toy prompting， since tasks include CAD， architecture， animation， audio， data analysis， and web apps. This means the benchmark is testing computer work across messy tools， not narrow text answers.

Fable 5 looked strongest on examples like ring modeling， animation， and bathroom design.

The automated judge ranked models well， but overstated GPT-5.5 by about 2.9x and Opus 4.8 by about 2.3x. The result says AI agents are improving fast， but quality control remains the hard wall.

Another key point is that the model alone is not the whole product anymore. The gains are coming from stronger agent setups： better tool use， full desktop environments， professional software， longer runtimes， and worker-critic loops where 1 agent does the task and another reviews it like a demanding client.

Rohan Paul@rohanpaul_ai · X

51导出 Markdown