# LoopArena 基准发布：评估模型作为循环工程的运行时控制器

- 来源：DAIR.AI (@dair_ai)
- 发布时间：2026-09-01 03:44
- AIHOT 分数：45
- AIHOT 链接：https://aihot.virxact.com/items/cmthnd74305kfro1pmlm583d9
- 原文链接：https://x.com/dair_ai/status/2094511549306315189

## AI 摘要

AMAP 团队发布 LoopArena 基准（arXiv:2608.28281），评估模型作为 Controller 引导独立固定 Worker 编码智能体完成长任务的外层循环能力，而非编码智能体本身。

## 正文

Loop engineering has emerged as a new skill for AI engineers

But there is very little research measuring how effective it is.

The best results on full tasks in a new benchmark is ~25%.

LoopArena from AMAP evaluates the outer loop rather than the coding agent.

A Controller model receives a structured summary after each round and instructs a separate fixed Worker agent on what to do or verify next, or decides to stop. Holding the Worker constant makes the result readable, since an end-to-end run cannot tell you whether success came from the guidance or from the agent carrying it out.

The named failure modes will be familiar to anyone running long agent sessions:

• Trusting a stale progress note
• Skipping needed verification
• Spending budget in the wrong direction
• Stopping before the task is safe to submit

Paper: https://arxiv.org/abs/2608.28281

Chat with Paper: https://academy.dair.ai/papers/looparena-benchmarking-models-as-runtime-controllers-for-loop-engineering-2608.28281