# Echo-Memory：动作世界模型中记忆机制的控制研究

- 来源：HuggingFace Daily Papers（社区热门论文）
- 发布时间：2026-06-08 08:00
- AIHOT 分数：60
- AIHOT 链接：https://aihot.virxact.com/items/cmq63xg0l04wysl5idk7fp8lt
- 原文链接：https://arxiv.org/abs/2606.09803

## AI 摘要

Echo-Memory固定视频扩散骨干、优化器、相机动作表示、采样器和评估流水线，比较原始上下文、压缩记忆、空间摘要（不同读取路径）和状态空间循环四种记忆设计。三分支评估（回放质量、域内循环重访、开放域返回）显示排序常不一致，回放保真度不足以代理世界记忆。发现：原始上下文提升开放域返回远超回放指标；紧凑无法替代容量，激进空间与混合压缩丢失关键证据；块状态空间循环在开放域返回中最强，隐式记忆结构与使用同等重要。

## 正文

We present Echo-Memory, a controlled study of memory mechanisms in action-conditioned world models. These models generate multi-segment videos from a first frame, text prompt, and camera-action sequence, but their central failure is often memory rather than local image synthesis: after the camera leaves and returns, the scene or salient object may silently change. Existing memory designs are hard to compare because gains are entangled with backbone, training, retrieval, and evaluation differences. Echo-Memory fixes the action-to-video interface and varies only how history is stored and read by the generator. Under a shared video diffusion backbone, optimizer, camera-action representation, sampler, and evaluation pipeline, we compare raw context, compression-based memory, spatial summaries with different read-out paths, and state-space recurrence. This matched matrix separates four otherwise conflated axes: capacity, compression, read-out, and recurrence. We also evaluate memory through a three-branch protocol: replay quality, in-domain loop revisit, and open-domain return probes. The branches routinely disagree, showing that replay fidelity is not a sufficient proxy for remembering a world. Three findings follow. Raw context is a strong capacity baseline and improves open-domain return far more than it improves replay metrics. Compactness is not a free substitute for capacity: aggressive spatial and hybrid-compression memories lose the salient evidence needed for return. Finally, block-wise state-space recurrence is the strongest open-domain return mechanism in our matrix, showing that the structure of implicit memory matters as much as the decision to use it. These results provide a compact protocol for studying memory in action world models beyond isolated replay metrics.