测试大模型代理在分解攻击下的安全漏洞,发现看似无害的分步操作可能暗藏恶意。
Hidden in Plain Sight: Benchmarking Agent Safety Against Decomposition Attacks with DECOMPBENCH

- 设计图形化框架,将有害任务拆解为看似无害的子任务
- 顶尖代理对整体恶意任务拒绝率高,但对分解后任务拒绝率显著降低
- 揭示现有安全机制在复杂攻击流面前的薄弱,适合安全研究者参考
基于大语言模型的智能体日益强大且广泛应用,导致现实世界中出现越来越多的恶意滥用动机。一种新兴威胁是分解攻击:将有害任务拆分为多个简单、看似无害的子任务,单独执行时可避开安全检测,但组合起来却达成恶意目标。尽管现有基准评估了多轮和多工具使用场景下的代理安全,却未专门涵盖此类分解式滥用,可能无法反映真实攻击流程。为此,我们提出 DeCompBench,一个专为评估分解攻击下代理安全性而设计的基准。该基准采用“按设计分解”原则,结合图形化框架,支持将有害任务分解为独立、合法且具备真实工作流的子任务。实验表明,使用自研分解器,当前最先进代理对整体恶意任务拒绝率较高,但对分解后的变体拒绝率明显下降,且常无意中完成攻击目标。结果凸显了针对分解攻击进行安全评估与防御的必要性。数据集已公开,可访问 https://huggingface.co/datasets/decompositionbench/DeCompBench。
原文摘要 · Abstract (English)
LLM-based Agents are becoming increasingly capable and widely deployed, creating growing incentives for adversarial misuse in the real-world. A key emerging threat is Decomposition Attacks \cite{glukhov2024breach, jones2024adversaries} in which a harmful task is broken into simpler, benign subtasks that evade safety mechanisms when executed separately but cumulatively fulfill the malicious intent. Although recent benchmarks assess agent safety in multi-turn and multi-tool-use settings, they do not explicitly capture this form of decompositional misuse and may not represent realistic adversarial execution flows. To this end, we introduce DeCompBench, a benchmark designed specifically to evaluate agentic safety under decomposition attacks. DeCompBench is created with a decomposition-by-design principle using a graphical framework and enables harmful task decomposition into individually benign and executable subtasks with realistic workflows. Our experiments using a custom decomposer show that state-of-the-art agents exhibit high refusal rates on monolithic harmful tasks, but significantly lower refusal rates on their decomposed variants, while often inadvertently fulfilling the adversarial objectives. These findings underscore the need for safety evaluations against decomposition attacks and corresponding defenses. Our dataset is publicly available and can be found at https://huggingface.co/datasets/decompositionbench/DeCompBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。