针对多模态网页代理的跨模态攻击,提出协同训练增强鲁棒性。
Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks
- 构建双模态对抗训练框架,分三阶段联合优化代理与攻击者。
- 在分布外任务上,攻击成功率下降显著,任务完成效率翻倍。
- 适合安全防护、智能代理研发人员,尤其关注跨模态攻击场景。
多模态网页代理同时处理截图和可访问性树,日益广泛应用于网页交互,但其双流架构存在未被充分研究的攻击面:攻击者通过篡改DOM内容,可同步污染两个观察通道并传递一致误导信息。对MiniWob++的漏洞分析表明,含视觉成分的攻击远超纯文本注入,暴露出以文本为中心的VLM安全训练的严重缺陷。为此,我们提出双模态多阶段对抗安全训练(DMAST),将代理-攻击者互动建模为二人零和马尔可夫博弈,并通过三阶段流水线协同训练:(1) 从强教师模型中进行模仿学习;(2) 基于新型零确认策略的有监督微调,强化对抗噪声下的任务聚焦推理;(3) 采用组相对策略优化(GRPO)自对弈的对抗强化学习。在分布外任务上,DMAST显著降低对抗风险,同时任务完成效率提升一倍。该方法优于现有基于训练和提示的防御方案,展现出真正的共进化进展与对复杂未知环境的鲁棒泛化能力。
原文摘要 · Abstract (English)
Multimodal web agents that process both screenshots and accessibility trees are increasingly deployed to interact with web interfaces, yet their dual-stream architecture opens an underexplored attack surface: an adversary who injects content into the webpage DOM simultaneously corrupts both observation channels with a consistent deceptive narrative. Our vulnerability analysis on MiniWob++ reveals that attacks including a visual component far outperform text-only injections, exposing critical gaps in text-centric VLM safety training. Motivated by this finding, we propose Dual-Modality Multi-Stage Adversarial Safety Training (DMAST), a framework that formalizes the agent-attacker interaction as a two-player zero-sum Markov game and co-trains both players through a three-stage pipeline: (1) imitation learning from a strong teacher model, (2) oracle-guided supervised fine-tuning that uses a novel zero-acknowledgment strategy to instill task-focused reasoning under adversarial noise, and (3) adversarial reinforcement learning via Group Relative Policy Optimization (GRPO) self-play. On out-of-distribution tasks, DMAST substantially mitigates adversarial risks while simultaneously doubling task completion efficiency. Our approach significantly outperforms established training-based and prompt-based defenses, demonstrating genuine co-evolutionary progress and robust generalization to complex, unseen environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。