腾讯发布 ContextPilot:用细粒度 RL 训练智能体主动管理工作上下文

elvis · @omarsar0 · X·2026-09-01 03:20·18小时前
AI 导读

腾讯联合清华、上海 AI Lab 发布 ContextPilot 论文,训练智能体主动管理自身工作上下文,并在单次上下文编辑层面分配信用。方法在搜索、删除、摘要之外加入全局规划、长期记忆和自适应软压缩,让智能体可以卸载信息而非只能丢弃;训练上利用上下文与熵变化定位关键编辑决策,采样分支并从经过该编辑的分支轨迹估计动作级优势。

elvis@omarsar0
42AI 编辑部评分,满分 100

腾讯发布 ContextPilot:用细粒度 RL 训练智能体主动管理工作上下文

2026-09-01 03:20· 18小时前
AI 导读

腾讯联合清华、上海 AI Lab 发布 ContextPilot 论文,训练智能体主动管理自身工作上下文,并在单次上下文编辑层面分配信用。方法在搜索、删除、摘要之外加入全局规划、长期记忆和自适应软压缩,让智能体可以卸载信息而非只能丢弃;训练上利用上下文与熵变化定位关键编辑决策,采样分支并从经过该编辑的分支轨迹估计动作级优势。

Interesting paper from Tencent.

Tencent trains an agent to manage its own working context, and assigns credit at the level of individual context edits.

Long-horizon tasks force a model to retrieve, integrate and maintain scattered information across many turns, and keeping every interaction history makes the working context grow without bound.

Recent proactive methods let a model edit its own context with tools, but the toolset stops at search, deletion and summarization.

ContextPilot adds global planning, long-term memory and adaptive soft compression, so the agent can offload information rather than only discard it.

The training side is where it gets interesting. Standard RL hands the final trajectory reward to every intermediate edit equally. ContextPilot uses context and entropy variation to find which editing decisions actually mattered, samples branches at those points, and estimates action-level advantages from all branched trajectories passing through that edit.

On long-context QA and deep search it beats existing baselines across several base models while holding a more compact working context. Code is available.

Paper: https://arxiv.org/abs/2608.28476

Chat with Paper: https://academy.dair.ai/papers/contextpilot-teaching-agents-for-proactive-context-management-via-fine-grained-r-2608.28476