arXiv:2607.02345cs.SEcs.AI2026-07被引 1

提出新方法自动发现技能组合中的隐藏恶意意图,提升开放技能市场安全

SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces

论文配图:SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces
图 1 · 摘自论文原文
  • 将技能组合测试建模为模糊测试,用结构化契约指导搜索
  • 在固定预算下发现超1000种隐含意图,验证成功率超80%
  • 适合平台方和安全研究人员用于检测潜在协同攻击

基于大语言模型的智能体通过可复用的技能(自然语言指令)自动化软件工程任务。开放技能市场允许用户组合社区贡献的技能构建智能体,但平台通常孤立审核技能。导致看似无害的技能组合可能在执行时引导向非预期目标,称为隐含意图。检测此类意图困难:效果仅在组合执行时显现,且执行环境常不可得,组合空间随市场规模呈指数增长。本文将隐含意图发现建模为技能组合的模糊测试问题,以组合为测试单元,利用规划产物在执行前暴露智能体意图,以与无技能基线的偏差作为差异性判定依据。基于此,提出SkillFuzz,首个无需执行的测试方法,通过提取结构化技能契约,并使用契约引导的蒙特卡洛树搜索优先探索潜在冲突组合。在典型工作负载下,SkillFuzz在固定查询预算内发现超过1000种不同隐含意图,执行阶段验证中确认超过80%高风险组合,且发现的严重隐含意图数量显著多于其他搜索策略,仅需探索其所需配对交互空间的一小部分。

原文摘要 · Abstract (English)

Large Language Model (LLM)-based agents increasingly automate software engineering tasks through reusable skills, natural-language instruction documents that guide planning and execution. Open skill marketplaces enable users to assemble agents by co-activating community-contributed skills, but marketplace operators typically audit skills in isolation. As a result, individually benign skills may interact to redirect an agent toward unintended objectives, which we term implicit intents. Detecting such intents is challenging because the effect emerges only through skill composition, execution environments are often unavailable at admission time, and the space of possible co-activations grows exponentially with marketplace size. In this paper, we formulate implicit-intent discovery as a fuzzing problem over skill compositions, where skill compositions are the unit under test, planning artifacts expose agent intent before execution, and deviations from a skill-free baseline serve as a differential oracle. Based on this formulation, we propose skillfuzz, the first execution-free testing approach that extracts structured skill contracts and uses contract-guided Monte Carlo Tree Search to prioritize potentially conflicting compositions. Across representative skill-marketplace workloads, skillfuzz discovers over 1,000 distinct implicit intents under a fixed query budget, confirms more than 80% of the highest-risk flagged compositions during execution-time validation, and identifies substantially more high-severity implicit intents than alternative search strategies while exploring only a fraction of the pairwise interaction space they require.

智能体安全模糊测试技能组合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。