# 微软 ThinkingBox：智能体可靠性评测沙盒

- 来源：Rohan Paul (@rohanpaul_ai)
- 发布时间：2026-08-23 20:19
- AIHOT 分数：32
- AIHOT 链接：https://aihot.virxact.com/items/cmt5sz80n0q23ro73bld4no8g
- 原文链接：https://x.com/rohanpaul_ai/status/2091500598680268862

## AI 摘要

微软发布论文指出，智能体“成功一次”不等于“可靠”：最佳智能体在业务任务中单次成功率 91%，但每次都能成功的比例仅 25%，因此需以重复测试衡量可靠性。研究发现 4/5 的失败运行会礼貌地调用写数据库工具并声称任务完成，但实际记录并未更新。为此微软构建 ThinkingBox 沙盒，让智能体在真实工具、模拟客户和实时后端上运行，事后检查数据库而非读取回复。

## 正文

Very relevant Microsoft paper on agent reliability.

Succeeding once and being reliable are not the same thing.

The best agent solved 91% of business tasks at least once but only 25% every time, so measure repeats.

The failures are also hard to spot from the outside.

4 out of 5 failed runs ended politely and called a tool that writes to the database.

The agent said the job was done, but the records said otherwise.

So Microsoft built ThinkingBox, a sandbox that runs an agent against real tools, a simulated customer, and a live backend, then checks the database afterward instead of reading the reply.

---

– arxiv. org/abs/2608.19741

Title: "One Success Isn't Reliability: Thinkingbox, a Sandbox and Benchmark for Agents in Stateful Business Workflows"