arXiv:2605.15030cs.CRcs.AI2026-05被引 3

提出防御网页代理提示注入攻击的高效安全框架WARD。

WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections

论文配图:WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
图 1 · 摘自论文原文
  • 基于17.7万样本数据集,构建可泛化的新防御模型。
  • 在未见场景下召回率接近完美,误报率低且无额外延迟。
  • 支持自适应对抗训练,适合高风险在线代理部署。

网页代理可通过与网站交互自主完成在线任务,但其暴露于开放网络环境易受嵌入在HTML内容或视觉界面中的提示注入攻击。现有防护模型普遍存在对未见领域和攻击模式泛化能力差、良性内容误报率高、每步增加延迟影响部署效率,以及易受随时间演变或直接针对防护模型的对抗攻击等问题。为此,我们提出WARD(Web Agent Robust Defense against Prompt Injection),一种面向安全高效的网页代理防护框架。WARD基于大规模数据集WARD-Base(约17.7万样本,覆盖719个高流量网址与平台)和专为针对防护模型设计的提示注入攻击数据集WARD-PIG构建。我们进一步引入A3T自适应对抗攻击训练框架,通过记忆型攻击者与防护模型的迭代共进化过程持续强化系统。大量实验表明,WARD在分布外基准上实现近乎完美的召回率,保持低误报率以保障代理可用性,在显著分布偏移下仍能抵御针对防护模型的自适应攻击,并可与代理并行运行,不引入额外延迟。

原文摘要 · Abstract (English)

Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.

网页代理提示注入对抗防御安全框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。