内容
精选全部 AI 动态AI 日报主题收藏
接入
Agent 接入
更多
关于更新日志反馈
京ICP备2026012723号-2
原文
Rohan Paul@rohanpaul_ai
31
2026-07-23 13:52· 1天前
跳到正文
AI 摘要

研究发现,即使是强大的推理模型在处理长输入时也会养成复制大段文本的“懒惰”习惯,且输入越长问题越严重,这会消耗token预算并降低准确性。复制无关内容会导致错误,而只复制关键行则有助于正确回答。研究者提出一种基于证据感知的强化学习奖励机制,通过奖励模型关注关键文本、惩罚复制无关内容,将准确率提升最多4.6个百分点。

Many assumed that once long-context models could reason, the old challenge of simply finding the right text was behind us.

This paper shows that is wrong. Even strong reasoning models slip into a lazy habit of copying big chunks of the input into their own thinking, and the habit gets worse the longer the input is, quietly eating their token budget and dragging accuracy down.

Copying itself is fine; the damage comes from copying the wrong stuff. Models that copy the few lines that actually matter tend to get the answer right, while models that copy the surrounding filler tend to get it wrong.

They developed a simple reward that stops long-context language models from mindlessly copying their input, lifting accuracy by up to 4.6 points.

The fix rewards the model for engaging with the small set of text that actually matters and penalizes it for copying the irrelevant filler around it.

  • arxiv. org/abs/2607.19345

Title: "Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning"

arXiv数据/训练
Rohan Paul@rohanpaul_ai · X
31导出 Markdown
2026-07-23 13:52·1天前
在 X 看原推· x.com
AI 摘要

研究发现,即使是强大的推理模型在处理长输入时也会养成复制大段文本的“懒惰”习惯,且输入越长问题越严重,这会消耗token预算并降低准确性。复制无关内容会导致错误,而只复制关键行则有助于正确回答。研究者提出一种基于证据感知的强化学习奖励机制,通过奖励模型关注关键文本、惩罚复制无关内容,将准确率提升最多4.6个百分点。

Many assumed that once long-context models could reason, the old challenge of simply finding the right text was behind us.

This paper shows that is wrong. Even strong reasoning models slip into a lazy habit of copying big chunks of the input into their own thinking, and the habit gets worse the longer the input is, quietly eating their token budget and dragging accuracy down.

Copying itself is fine; the damage comes from copying the wrong stuff. Models that copy the few lines that actually matter tend to get the answer right, while models that copy the surrounding filler tend to get it wrong.

They developed a simple reward that stops long-context language models from mindlessly copying their input, lifting accuracy by up to 4.6 points.

论文/研究
在 X 查看原推导出 Markdown

The fix rewards the model for engaging with the small set of text that actually matters and penalizes it for copying the irrelevant filler around it.

  • arxiv. org/abs/2607.19345

Title: "Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning"

arXiv数据/训练论文/研究
在 X 查看原推x.com