# Metis：把记忆内化进 LLM 自身状态

- 来源：Rohan Paul (@rohanpaul_ai)
- 发布时间：2026-08-10 04:06
- AIHOT 分数：36
- AIHOT 链接：https://aihot.virxact.com/items/cmsm8r0lv04lfro980foz99j5
- 原文链接：https://x.com/rohanpaul_ai/status/2086544779974955262

## AI 摘要

Metis 提出将记忆作为 LLM 自身能力，通过骨干网络内的持久记忆状态，在前向传播中压缩过往交互，而非外挂检索系统。无上下文设置下，Metis-27B 在 LoCoMo (Gold) 得分 26.74，远超 vanilla Qwen3.5-27B 的 0.07 和 Temp-LoRA-27B 的 4.24，但仍低于全上下文 Qwen3.5-27B 的 65.03。

## 正文

This is such a wild idea.

What if memory were a capability of the LLM itself, rather than a retrieval system bolted around it?

Can an LLM remember something from an earlier interaction without having to feed that old interaction back into its prompt?

Metis proposes a foundation model with a persistent memory state inside the backbone, updated during ordinary forward passes while the learned model weights stay frozen.

Instead of storing memories as text and retrieving them later, Metis compresses past interactions directly into the model's internal state. through a separate memory-attention path.

Normal LLMs don't keep a persistent memory of past interactions. If you tell one "Alice lives in Beijing," an external memory system usually has to save and retrieve that fact later. Metis instead compresses the interaction into an internal numerical memory state that stays inside the model and can be used in future calls.

The model is mid-trained to learn memory procedures such as remembering, updating, forgetting, and reflecting, rather than relying on hand-written retrieval rules.

Under the no-context setting, Metis-27B scores 26.74 on LoCoMo (Gold), versus 0.07 for the vanilla Qwen3.5-27B backbone and 4.24 for Temp-LoRA-27B.

It is still well below Qwen3.5-27B with full context at 65.03, so native memory has not replaced replaying history.

The failure mode is also revealing: performance drops as more information is compressed into the fixed-size state, and irrelevant stored memory can interfere with ordinary tasks.

The bigger direction here is making memory part of model computation itself, but Metis also exposes the hard part: that internal state has to stay selective, stable, and non-interfering.