对抗式审查:结构化分歧提升智能体代码审查

Rohan Paul · @rohanpaul_ai · X·2026-08-24 21:09·13小时前
AI 导读

一篇论文提出用“对抗式审查”规则提升AI智能体代码审查:审查者与批评者需用代码证据回应分歧,而非简单互相认同。在LiveCodeBench上,3个智能体达87%准确率,优于5智能体版本的82%;在真实PR审查中,该规则将F1分数从0.457提升至0.533,跃居首位。

Rohan Paul@rohanpaul_ai
36AI 编辑部评分,满分 100

对抗式审查:结构化分歧提升智能体代码审查

2026-08-24 21:09· 13小时前
AI 导读

一篇论文提出用“对抗式审查”规则提升AI智能体代码审查:审查者与批评者需用代码证据回应分歧,而非简单互相认同。在LiveCodeBench上,3个智能体达87%准确率,优于5智能体版本的82%;在真实PR审查中,该规则将F1分数从0.457提升至0.533,跃居首位。

2 AI agents set to check each other's work will usually end up agreeing, whether or not the code is right.

So the thing to add is not another reviewer but a rule about what an objection has to contain before either side is allowed to drop it.

This paper shows a reviewer plus a critic beating much larger review teams at writing code, then failing at reviewing code until that rule is in place.

The structure is small: the code stays frozen while a reviewer writes a review and a critic audits it, and only the settled review goes back for edits.

On LiveCodeBench it reaches 87% with 3 agents, against 82% for a 5-agent version.

On real pull-request review it lands last, at 0.457 F1. One prompt change fixes that: the critic must state whether its objection cites code or is only a hunch, and the reviewer has to answer with code either way, which takes it to 0.533 and the top of the set.

So the second agent only helps when agreement has to be paid for with code evidence; without that rule it mostly ratifies the first.

– arxiv. org/abs/2608.18167

Title: "Adversarial Review: Structured Disagreement for Grounded Agentic Code Review"

来源:Rohan Paul· x.com