Rohan Paul@rohanpaul_ai
45AI 编辑部评分,满分 100
2026-08-12 05:53· 39分钟前
AI 导读

论文警告,AI 隐藏推理过程可成为第二重隐形数据泄露源,清理可见对话后仍可能泄露密码、API 密钥等敏感信息。研究者从 6,708 条轨迹中解码 315,320 个推理块,4.9% 会话泄露敏感项,恢复 62 个 API 密钥、33 个密码等。Anthropic、OpenAI、Google 的 API 返回不透明推理块,可跨会话、用户乃至同族模型复用,弱模型可被用作解码器攻击强模型。

Very big warning from this paper.

Your AI's hidden reasoning can become a second, invisible data leak.

You can clean the visible chat and still accidentally publish passwords, API keys, or private data.

A company can secure its smartest model perfectly and still lose its secrets through a cheaper model in the same family. The weakest model can become the security hole for the strongest one.

Encrypted reasoning is supposed to hide what frontier models think, but this paper shows the encrypted blob itself can become the attack surface.

Anthropic, OpenAI, and Google APIs return opaque reasoning blocks to clients so they can be replayed in later turns without storing the reasoning server-side.

The problem is portability: the authors found these blocks could be reused across sessions, users, and even models within the same provider.

That lets an attacker take a trace from a stronger model, feed it to a weaker compatible sibling with looser safeguards, and use that model as a decoder.

Across public agent logs, the team decoded 315,320 reasoning blocks from 6,708 trajectories; 328 sessions, or 4.9%, leaked at least one sensitive item.

In genuine user sessions, they recovered 62 API keys, 33 passwords, 24 access tokens, and 30 personal emails.

So an encrypted reasoning field in a log is not necessarily safe metadata if another model can read it.

After responsible disclosure, providers patched the reported attacks, and the exact exploits were no longer reproducible by August 2026.

来源:Rohan Paul · x.com

Rohan Paul · @rohanpaul_ai · X·2026-08-12 05:53·39分钟前
AI 导读

论文警告,AI 隐藏推理过程可成为第二重隐形数据泄露源,清理可见对话后仍可能泄露密码、API 密钥等敏感信息。研究者从 6,708 条轨迹中解码 315,320 个推理块,4.9% 会话泄露敏感项,恢复 62 个 API 密钥、33 个密码等。Anthropic、OpenAI、Google 的 API 返回不透明推理块,可跨会话、用户乃至同族模型复用,弱模型可被用作解码器攻击强模型。

Very big warning from this paper.

Your AI's hidden reasoning can become a second, invisible data leak.

You can clean the visible chat and still accidentally publish passwords, API keys, or private data.

A company can secure its smartest model perfectly and still lose its secrets through a cheaper model in the same family. The weakest model can become the security hole for the strongest one.

Encrypted reasoning is supposed to hide what frontier models think, but this paper shows the encrypted blob itself can become the attack surface.

Anthropic, OpenAI, and Google APIs return opaque reasoning blocks to clients so they can be replayed in later turns without storing the reasoning server-side.

The problem is portability: the authors found these blocks could be reused across sessions, users, and even models within the same provider.

That lets an attacker take a trace from a stronger model, feed it to a weaker compatible sibling with looser safeguards, and use that model as a decoder.

Across public agent logs, the team decoded 315,320 reasoning blocks from 6,708 trajectories; 328 sessions, or 4.9%, leaked at least one sensitive item.

In genuine user sessions, they recovered 62 API keys, 33 passwords, 24 access tokens, and 30 personal emails.

So an encrypted reasoning field in a log is not necessarily safe metadata if another model can read it.

After responsible disclosure, providers patched the reported attacks, and the exact exploits were no longer reproducible by August 2026.

来源:Rohan Paul· x.com