# 自进化智能体论文：将日常操作转化为学习数据

- 来源：Rohan Paul (@rohanpaul_ai)
- 发布时间：2026-08-01 22:20
- AIHOT 分数：33
- AIHOT 链接：https://aihot.virxact.com/items/cmsagwilw058vrob36a638g64
- 原文链接：https://x.com/rohanpaul_ai/status/2083558368191611165

## AI 摘要

论文提出企业智能体需将日常操作转化为安全学习数据方能真正改进，并设计三部分机制：记录智能体步骤、用数据代理清洗与管理真实轨迹、通过控制层决定更新记忆、技能、提示词、工具或模型权重。AREAL2.0 展示了在线 RL 路由 LLM 调用的窄版本实现。作者指出核心缺口是构建将智能体活动转为可用学习数据的系统，而非更优优化器。

## 正文

Great paper on Self-evolving agents.

Enterprise agents cannot truly improve until their messy daily work becomes safe learning data.

A future enterprise agent may improve by updating memory before changing its underlying model.

The problem is that deployed agents generate many useful traces， but teams usually improve them through slow manual inspection， prompt edits， retraining， and redeployment.

They propose a 3-part mechanism： first， record every agent step in a shared learning-ready format； second， use a data proxy to clean， govern， store， and replay real agent work； third， use a control layer to decide whether to update memory， skills， prompts， tools， or model weights.

AREAL2.0 shows one narrow version of this idea， where live agent LLM calls are routed through an online RL service so real interaction traces can train future model updates.

The authors say the main gap is a system that turns agent activity into usable learning data， not another clever optimizer.

Future agents will need safe， replayable ways to update memory， skills， prompts， tools， or models without becoming uncontrolled.

----

- arxiv. org/abs/2607.01120v1

Title： "Next-Generation Agentic Reinforcement Learning Systems Enable Self-Evolving Agents"