NPO 单线提示优化以更少预算追平 GEPA

elvis · @omarsar0 · X·2026-08-31 07:00·54分钟前
AI 导读

NPO 提示优化器仅用单条提示谱系,在 3,500 和 6,800 次 rollout 下追平 GEPA(3,593 和 6,871 次),并在 22 个 TextArena 游戏中表现相当。其优势随教师模型增强而扩大,表明复杂搜索或一直在弥补弱教师推理。

elvis@omarsar0
44AI 编辑部评分,满分 100

NPO 单线提示优化以更少预算追平 GEPA

2026-08-31 07:00· 54分钟前
AI 导读

NPO 提示优化器仅用单条提示谱系,在 3,500 和 6,800 次 rollout 下追平 GEPA(3,593 和 6,871 次),并在 22 个 TextArena 游戏中表现相当。其优势随教师模型增强而扩大,表明复杂搜索或一直在弥补弱教师推理。

Interesting paper on prompt optimization.

They claim that a single-lineage prompt optimizer just matched GEPA on a smaller rollout budget.

Prompt optimization has been drifting toward heavier machinery, with candidate pools, reflection trees, and Pareto-based selection.

NPO keeps one lineage. At each iteration it runs the student on the current prompt, collects rollout traces and rewards, and hands a sliding window of recent iterations to a teacher model that rewrites the prompt.

There is no candidate population and no search tree.

On the two instruction-following benchmarks it spends 3,500 and 6,800 rollouts against GEPA's 3,593 and 6,871, and it stays broadly comparable across 22 TextArena games.

The interaction with teacher strength is what makes this interesting. NPO's advantage grows as the teacher model gets stronger, which suggests optimizer-side search complexity has been compensating for weak teacher reasoning all along.

Paper: https://arxiv.org/abs/2608.27266

Chat with Paper: https://academy.dair.ai/papers/naive-prompt-optimization-rethinking-the-need-for-complex-prompt-search-2608.27266