HarnessRisk:面向智能体 Harness 安全的全生命周期基准

HuggingFace Daily Papers(社区热门论文)·2026-08-18 08:00·7天前
AI 导读

HarnessRisk 将智能体 harness 安全划分为配置、能力扩展、运行时、状态持久化、动作控制与事故恢复六个阶段,含 128 个沙箱用例。在三种 harness、六个语言模型及 14 种配置下,攻击成功率介于 12.6% 至 80.9%,Utility 保持在 75.0% 至 97.6% 之间。Harness 配置阶段最易受攻击,且显式风险识别并不总能带来安全行动。

HuggingFace Daily Papers(社区热门论文)
58AI 编辑部评分,满分 100

HarnessRisk:面向智能体 Harness 安全的全生命周期基准

2026-08-18 08:00· 7天前
AI 导读

HarnessRisk 将智能体 harness 安全划分为配置、能力扩展、运行时、状态持久化、动作控制与事故恢复六个阶段,含 128 个沙箱用例。在三种 harness、六个语言模型及 14 种配置下,攻击成功率介于 12.6% 至 80.9%,Utility 保持在 75.0% 至 97.6% 之间。Harness 配置阶段最易受攻击,且显式风险识别并不总能带来安全行动。

Large language models are increasingly deployed through agent harnesses that manage tools, extensions, persistent state, permissions, and external actions. Existing safety benchmarks mainly target individual attack mechanisms or a limited subset of operational settings, making it difficult to compare how safety failures emerge across different harness responsibilities. We present HarnessRisk, a lifecycle oriented benchmark that organizes agent harness safety into six operational phases including Harness Configuration, Capability Extension, Runtime Operation, State Persistence, Action Control, and Incident Recovery. HarnessRisk contains 128 sandboxed cases, each pairing a benign user objective with an adversarial instruction embedded in an untrusted workflow artifact. We evaluate each trajectory using Utility, Attack Success Rate, Persistence, and Detection. Across three harnesses, six language models, and 14 model and harness configurations, attack success ranges from 12.6% to 80.9%, while Utility remains between 75.0% and 97.6%. Harness Configuration is the most vulnerable phase across all three harnesses, showing that attacks can succeed by altering security sensitive parameters within otherwise authorized workflows. We also find that explicit risk recognition does not reliably lead to safe action, as some configurations detect risks in more than 90% of runs while retaining substantial attack success. These results highlight the need to evaluate agent safety across multiple harness responsibilities and at the level of the deployed model and harness configuration.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org