单一技能看似安全,组合使用却可能引发严重安全漏洞。
Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystems

- 通过构建受控环境评估多个技能组合的潜在风险
- 组合场景下攻击成功率最高达96.5%,远超单独测试结果
- 适合关注大模型智能体安全的开发者与研究人员
随着技能成为大模型智能体将计划转化为行动的能力层,其使用引入了数据泄露、未授权操作和工具误用等安全风险。现有评估通常孤立地检验每个技能,而真实任务常在共享执行上下文中调用多个技能。这导致技能组合风险(SCR):一个单独看似无害的技能,在与其他技能协同时,其输出、信任信号、授权线索或副作用可能影响后续调用路径,从而产生危害。我们提出SCR-Bench,在沙盒环境中评估此类风险。该基准不依赖文本意图或表面行为,而是记录组合执行中的状态变化与路径级结果。包含三个子基准:SCR-CapFlow(能力流组合)、SCR-TrustLift(信任传递组合)和SCR-AuthBlur(授权混淆组合)。在组合场景中,风险显著暴露:在SCR-CapFlow中,攻击成功率达33.6%,而孤立基线接近零;在SCR-TrustLift中,五个后端中有四个攻击成功率超过96.5%;在SCR-AuthBlur中,相对于L0基线,风险审批率在L1环境下上升71.8%。结果表明,智能体技能安全应基于激活路径而非孤立对象评估。SCR与SCR-Bench为路径感知的风险评估与防御提供了基础。基准代码:https://github.com/saint-viperx/SCR_Bench。
原文摘要 · Abstract (English)
Skills are becoming the capability layer through which LLM agents turn plans into actions, but their use introduces security risks such as data leakage, unauthorized operations, and tool misuse. Existing vetting usually evaluates each skill in isolation, while real agent tasks often invoke multiple skills in a shared execution context. This creates Skill Composition Risk (SCR): a skill that appears benign alone can become harmful when its outputs, trust signals, authorization cues, or side effects influence later invocations along an activated path. We introduce SCR-Bench to evaluate this risk in controlled, sandboxed skill environments. Rather than relying only on textual intent or surface behavior, SCR-Bench records downstream state changes and path-level outcomes across composed skill executions. It contains three sub-benchmarks: SCR-CapFlow for capability-flow composition, SCR-TrustLift for trust-transfer composition, and SCR-AuthBlur for authorization-confusion composition. Across SCR-Bench, composed paths expose risks that are largely absent under isolated evaluation. In SCR-CapFlow, attack success rate reaches 33.6 percent under composition, compared with near-zero isolated baselines. In SCR-TrustLift, attack success rate exceeds 96.5 percent on four of five backends. In SCR-AuthBlur, the risky-approval rate increases by 71.8 percent relative to the L0 isolated baseline under the L1 context setting. These results show that agent skill security should be assessed at the level of activated paths rather than isolated artifacts. SCR and SCR-Bench provide a foundation for path-aware risk evaluation and defense in LLM agent skill ecosystems. Benchmark: https://github.com/saint-viperx/SCR_Bench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。