Self-play is an effective paradigm for language-model self-evolution, but without guidance, solver performance can plateau or decline across rounds. Unguided methods steer question generation with signals such as difficulty, learnability, or diversity. These signals keep questions challenging and varied but do not specify which unresolved reasoning weaknesses later rounds should target. Guided methods obtain direction from external task resources, including human examples, document corpora, or specified difficulty targets, and therefore rely on task information supplied outside the self-play loop. We show that the needed direction can instead be derived from the solver's own failure history. We introduce DiagEvo, whose diagnostician extracts recurring error causes from this history and stores them in a hierarchical error-cause memory. The memory groups related causes under skill nodes and tracks each as Active or Mastered according to self-consistency on targeted questions. The challenger uses these states and recurrence counts to balance cause-targeted generation with free exploration. Double-confidence filtering retains intermediate-difficulty questions only when the most common solver answer has a clear vote lead. DiagEvo derives its curriculum from information produced during self-play, without external task resources. With the default 4B diagnostician, DiagEvo outperforms every baseline in mean accuracy across all nine benchmarks for each of the three solvers: Qwen3-4B, Qwen3-8B, and OctoThinker-8B. On Qwen3-8B, it reaches 72.3% mean accuracy across five mathematical reasoning benchmarks, 4.5 percentage points above R-Zero. Its mean accuracy across all nine benchmarks is 57.4%, 1.1 percentage points above DARC. Ablations show that the hierarchical error-cause memory and double-confidence filtering both contribute to these gains.
DiagEvo:基于分层错误记忆的诊断引导式自我进化
AI 导读
论文提出 DiagEvo,从求解器自身失败历史中提取反复出现的错误原因,存入分层错误原因记忆,并以此生成针对性问题,无需外部任务资源。其挑战者用记忆状态与复发次数平衡定向生成与自由探索,双重置信度过滤只保留中间难度问题。
HuggingFace Daily Papers(社区热门论文)
39
AI 编辑部评分,满分 100DiagEvo:基于分层错误记忆的诊断引导式自我进化
论文提出 DiagEvo,从求解器自身失败历史中提取反复出现的错误原因,存入分层错误原因记忆,并以此生成针对性问题,无需外部任务资源。其挑战者用记忆状态与复发次数平衡定向生成与自由探索,双重置信度过滤只保留中间难度问题。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org