SABER:面向LLM编码智能体的环境感知操作安全基准
阅读原文· arxiv.orgSABER是一个评估大语言模型编码智能体操作安全性的基准。与仅判断模型是否拒绝不安全提示的现有基准不同,它将模型置于真实的智能体风格项目中,根据一系列操作后的最终环境状态判定安全性,并按原因对违规行为分类。评估显示,即使表现最好的模型,其有害安全违规率也超过54%,说明当前对齐策略在真实项目环境中仍显不足。该基准已在GitHub公开。
Large language models are increasingly deployed as coding agents, shifting safety from individual responses to action sequences. Existing benchmarks, however, primarily assess whether models refuse unsafe prompts, leaving impacts on stateful workspaces largely unexamined. We present SABER, a benchmark for environment-aware operational safety that places models in realistic agent-style projects and evaluates safety from the final environment state after a sequence of actions. Beyond binary safety-violation reports, SABER categorizes violations by cause, enabling analysis of model-specific safety profiles. Our evaluations show that even the best-performing model has more than a 54% harmful safety-violation rate (HSR), suggesting that current alignment remains insufficient for realistic project environments. SABER further reveals distinct safety profiles across models. Our benchmark is publicly available at https://github.com/sssr-lab/saber.