arXiv:2510.01354cs.CRcs.AI2025-10被引 19

首个针对网页智能体的提示注入攻击检测基准,揭示现有方法在隐蔽攻击前的局限性。

WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents

  • 按威胁模型细分为四类攻击,构建含文本与图像的恶意/良性数据集
  • 显式指令或可见干扰的攻击可被中高精度识别,但隐性或不可察觉攻击几乎失效
  • 适合安全研究者、大模型部署方关注提示注入防御漏洞

针对网页智能体的提示注入攻击已有多项研究提出,同时各类通用提示注入检测方法也相继出现,但尚未有系统评估专门针对网页智能体。本文首次开展全面的基准研究,首先基于威胁模型对攻击进行细粒度分类;随后构建包含恶意与良性样本的数据集:不同攻击生成的恶意文本片段、四类良性文本片段、攻击生成的恶意图像以及两类良性图像;接着系统化整理文本与图像双模态检测方法;最后在多种场景下评估其性能。关键发现表明,部分检测器能以中高精度识别依赖显式文本指令或可见图像扰动的攻击,但在无显式指令或使用不可察觉扰动的攻击面前表现严重下降。相关数据集与代码已开源:https://github.com/Norrrrrrr-lyn/WAInjectBench。

原文摘要 · Abstract (English)

Multiple prompt injection attacks have been proposed against web agents. At the same time, various methods have been developed to detect general prompt injection attacks, but none have been systematically evaluated for web agents. In this work, we bridge this gap by presenting the first comprehensive benchmark study on detecting prompt injection attacks targeting web agents. We begin by introducing a fine-grained categorization of such attacks based on the threat model. We then construct datasets containing both malicious and benign samples: malicious text segments generated by different attacks, benign text segments from four categories, malicious images produced by attacks, and benign images from two categories. Next, we systematize both text-based and image-based detection methods. Finally, we evaluate their performance across multiple scenarios. Our key findings show that while some detectors can identify attacks that rely on explicit textual instructions or visible image perturbations with moderate to high accuracy, they largely fail against attacks that omit explicit instructions or employ imperceptible perturbations. Our datasets and code are released at: https://github.com/Norrrrrrr-lyn/WAInjectBench.

提示注入安全评估网页智能体多模态检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。