主动推理让AI智能体按需获取上下文

Rohan Paul · @rohanpaul_ai · X·2026-08-24 07:03·1天前
AI 导读

一篇论文提出用主动推理让AI智能体显式决策每次澄清、检索或工具调用是否值得其token与延迟成本。受控测试中,定向澄清将验证器合规率从0.0417提升至0.375,平均token使用从约112增至219。建议为智能体增加显式上下文获取层,而非将其视为自动行为。

Rohan Paul@rohanpaul_ai
36AI 编辑部评分,满分 100

主动推理让AI智能体按需获取上下文

2026-08-24 07:03· 1天前
AI 导读

一篇论文提出用主动推理让AI智能体显式决策每次澄清、检索或工具调用是否值得其token与延迟成本。受控测试中,定向澄清将验证器合规率从0.0417提升至0.375,平均token使用从约112增至219。建议为智能体增加显式上下文获取层,而非将其视为自动行为。

AI agents have an expensive problem: when a request is missing information, they either guess too early or keep asking, retrieving, and calling tools without knowing whether more context is worth the cost.

This paper uses active inference to make that choice explicit: every clarification, retrieval, tool call, or prompt test should earn its tokens, latency, or user effort by reducing uncertainty that matters to the final answer.

In controlled tests, frontier models steadily narrowed down hidden answers, yet still used more questions than an optimal planner.

On a generation task, targeted clarification raised verifier compliance from 0.0417 to 0.375, while average token use rose from about 112 to 219.

The practical recommendation is to give agents an explicit context-acquisition layer instead of treating context gathering as an automatic behavior.

Before each extra step, decide whether to ask, retrieve, inspect, or act.

Get only the missing context that changes the decision, then stop.