Rohan Paul@rohanpaul_ai
37AI 编辑部评分,满分 100
2026-08-05 13:05· 49分钟前
AI 导读

MemHarness在检索与行动间加入决策步骤,用同一策略比对记忆原始状态与当前状态,重写可迁移部分或拒绝记忆并直接推理。基于Qwen2.5-7B-Instruct,该方法在ALFWorld达85.2%、WebShop达75.6%成功率,优于无记忆强化学习的76.4%和66.1%。

Retrieving the right memory can still make an agent worse.

Most memory-augmented agents paste a semantically similar past experience into the current context, but similarity does not mean the old advice fits the agent's present state.

Retrieval finds what looks similar; MemHarness asks whether any of it still applies now.

MemHarness adds a decision step between retrieval and action: the same policy compares the memory's original state with the current one, rewrites the transferable part, or rejects it and reasons without memory.

That reconstruction is learned end to end with Group Relative Policy Optimization from task rewards, rather than supervised labels for the rewritten guidance.

Using Qwen2.5-7B-Instruct, the method reaches 85.2% success on ALFWorld and 75.6% on WebShop, versus 76.4% and 66.1% for reinforcement learning without memory.

Removing reconstruction drops ALFWorld to 79.6%, while injecting raw memory reaches only 70.1%, showing that retrieved experience can become noise when the state has changed.

More unusually, disabling memory at test time still leaves the trained policy at 83.0%, above the 76.4% reinforcement-learning baseline.

Within these two interactive benchmarks, memory reconstruction appears to do two jobs: adapt past experience during inference and train the policy to judge situations more carefully even when no memory is available.

  • arxiv. org/abs/2607.28272

Title: "MemHarness: Memory Is Reconstructed, Not Replayed"

来源:Rohan Paul · x.com

Rohan Paul · @rohanpaul_ai · X·2026-08-05 13:05·49分钟前
AI 导读

MemHarness在检索与行动间加入决策步骤,用同一策略比对记忆原始状态与当前状态,重写可迁移部分或拒绝记忆并直接推理。基于Qwen2.5-7B-Instruct,该方法在ALFWorld达85.2%、WebShop达75.6%成功率,优于无记忆强化学习的76.4%和66.1%。

Retrieving the right memory can still make an agent worse.

Most memory-augmented agents paste a semantically similar past experience into the current context, but similarity does not mean the old advice fits the agent's present state.

Retrieval finds what looks similar; MemHarness asks whether any of it still applies now.

MemHarness adds a decision step between retrieval and action: the same policy compares the memory's original state with the current one, rewrites the transferable part, or rejects it and reasons without memory.

That reconstruction is learned end to end with Group Relative Policy Optimization from task rewards, rather than supervised labels for the rewritten guidance.

Using Qwen2.5-7B-Instruct, the method reaches 85.2% success on ALFWorld and 75.6% on WebShop, versus 76.4% and 66.1% for reinforcement learning without memory.

Removing reconstruction drops ALFWorld to 79.6%, while injecting raw memory reaches only 70.1%, showing that retrieved experience can become noise when the state has changed.

More unusually, disabling memory at test time still leaves the trained policy at 83.0%, above the 76.4% reinforcement-learning baseline.

Within these two interactive benchmarks, memory reconstruction appears to do two jobs: adapt past experience during inference and train the policy to judge situations more carefully even when no memory is available.

  • arxiv. org/abs/2607.28272

Title: "MemHarness: Memory Is Reconstructed, Not Replayed"

来源:Rohan Paul· x.com