arXiv:2609.05535cs.CVcs.AI2026-09

测试视觉模型是否真用证据做判断,发现多数模型只答对不看图。

Beyond the Verdict: Evidence-Aligned Evaluation of Visual Prompt-Injection Guardrails

论文配图:Beyond the Verdict: Evidence-Aligned Evaluation of Visual Prompt-Injection Guardrails
图 1 · 摘自论文原文
  • 构建9954个带精确证据框的网页指令-截图对,测模型是否真依赖图像证据
  • 六模型平均精度相近,但证据对齐检测能力差9倍,最大差距达99.9%对58.7%
  • 提出无需训练的新方法,可提升模型看图准确率并检验指令与命令一致性

仅靠最终判断结果评估视觉语言模型(VLM)无法揭示其是否真正使用了应支持决策的视觉证据。本文聚焦于网页代理防护机制,研究VLM判断屏幕文本是否与用户指令冲突的问题。我们提出Mind2Web-Injection基准,包含9,954组指令-截图对,配有指令相关标签、像素级精确证据框及匹配的图像侧反事实样本。在六种VLM中,尽管两个模型平均精度几乎相同,但它们在证据对齐检测(EAD)指标上相差九倍,即正确检测且准确定位攻击的比例差异极大。为检验判断是否依赖被引用的指令作为证据,我们替换原指令为支持该命令的版本。结果显示,性能最强的开源本地化模型Qwen3-VL-32B仅在58.7%情况下给出一致判断,而GPT-5.6-luna达到99.9%。为诊断失败原因,我们提出两种无需训练的干预方法:ReadGate可提升模型对齐性而不改变原有判断,CmdCompare则通过显式比较指令与命令来解决指令侧不一致问题。这些发现呼吁将判决正确性、证据定位和反事实响应能力分开报告。

原文摘要 · Abstract (English)

Verdict-only evaluation does not reveal whether a vision-language model (VLM) used the visual evidence that should support its decision. We study this problem in web-agent guardrails, where a VLM judges whether on-screen text conflicts with a user instruction. We introduce Mind2Web-Injection, a benchmark of 9,954 instruction-screenshot pairs with instruction-relative labels, pixel-exact evidence boxes, and matched image-side counterfactuals. Across six VLMs, two models with nearly identical average precision differ ninefold in Evidence-Aligned Detection (EAD), the fraction of attacks both detected and correctly localized. To test whether a verdict depends on the command cited as evidence, we replace the instruction with one that endorses that command. Qwen3-VL-32B, the strongest open-weight localizer, returns aligned in only 58.7% of cases, whereas GPT-5.6-luna does so in 99.9%. To diagnose these failures, we propose two training-free interventions. ReadGate improves grounding without changing verdicts, while CmdCompare tests whether explicit instruction-command comparison resolves instruction-side inconsistency. These results motivate reporting verdict correctness, evidence localization, and counterfactual responsiveness separately.

视觉推理模型评估对抗攻击证据对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。