arXiv:2605.07414cs.MAcs.AI2026-05

通过智能编排模糊测试,突破文本到图像生成代理的安全防护

OrchJail: Jailbreaking Tool-Calling Text-to-Image Agents by Orchestration-Guided Fuzzing

论文配图:OrchJail: Jailbreaking Tool-Calling Text-to-Image Agents by Orchestration-Guided Fuzzing
图 1 · 摘自论文原文
  • 基于成功攻击路径学习高风险工具编排模式,精准引导模糊测试
  • 在多个主流T2I代理上实现更高成功率、更优图像质量与更低查询成本
  • 揭示工具编排是新型安全漏洞,适合安全研究者与模型开发者参考

工具调用型文本到图像(T2I)代理可通过多步工具链完成复杂生成与编辑任务。然而,这一能力引入了新的安全攻击面:个别看似无害的步骤组合可能产生有害输出,使得仅依赖提示词扰动的越狱方法失效。我们提出OrchJail,一种面向工具调用型T2I代理的编排引导模糊测试框架。其核心思想是利用高风险工具编排模式:通过学习成功越狱的工具调用轨迹及其与提示词表述的因果关系,直接引导模糊搜索向更可能触发不安全多步行为的提示词逼近,而非依赖表面文本扰动。大量实验表明,OrchJail在代表性工具调用型T2I代理上显著提升越狱效果与效率,实现更高的攻击成功率、更好的图像保真度和更低的查询开销,且对常见越狱防御具有鲁棒性。本工作揭示了工具编排作为此前未被探索的关键攻击面,并提供了发现T2I代理安全风险的新框架。

原文摘要 · Abstract (English)

Tool-calling text-to-image (T2I) agents can plan and execute multi-step tool chains to accomplish complex generation and editing queries. However, this capability introduces a new safety attack surface: harmful outputs may arise from tool orchestration, where individually benign steps combine into unsafe results, making prompt-only jailbreak techniques insufficient. We present OrchJail, an orchestration-guided fuzzing framework for jailbreaking tool-calling T2I agents. Its core idea is to exploit high-risk tool-orchestration patterns: by learning from successful jailbreak tool-calling traces and their causal relationships to prompt wording, OrchJail directly guides the fuzzing search toward prompts that are more likely to trigger unsafe multi-step tool behaviors, rather than relying on surface-level textual perturbations. Extensive experiments demonstrate that OrchJail improves jailbreak effectiveness and efficiency across representative toolcalling T2I agents, achieving higher attack success rates, better image fidelity, and lower query costs, while remaining robust against common jailbreak defenses. Our work highlights tool orchestration as a critical, previously unexplored attack surface and provides a novel framework for uncovering safety risks in T2I agents.

安全攻击工具调用越狱检测图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。