arXiv:2603.14707cs.CVcs.CL2026-03被引 6

提出视觉混淆代理漏洞并设计双通道防护机制,提升计算机使用代理的安全性。

Visual Confused Deputy: Exploiting and Defending Perception Failures in Computer-Using Agents

  • 通过双通道对比分类,分别验证点击目标和动作意图
  • 在真实界面截图中检测到97%的误点击攻击并成功拦截
  • 适用于自动化工具、RPA等依赖屏幕感知的智能代理

计算机使用代理(CUAs)直接操作图形界面,但其对屏幕内容的感知常不可靠。现有研究多将此类失败视为性能问题,关注操作是否成功,而非代理是否真正点击了正确对象。我们指出,这本质上是安全问题。本文形式化定义了‘视觉混淆代理’:由于接地错误、对抗性截图篡改或检查-使用时间竞争(TOCTOU),代理基于错误的屏幕状态授权操作。该漏洞可被实际利用:仅通过简单的屏幕级篡改,即可将常规点击重定向至特权操作,且难以与普通误操作区分。为此,我们提出首个运行在代理感知回路外的防护机制——双通道对比分类:独立评估(1)视觉点击目标与(2)代理对动作的推理是否符合部署特定知识库,并在任一通道检测到风险时阻断执行。关键洞察在于两通道互补:视觉证据捕捉目标错位,文本推理揭示看似无害控件背后的危险意图。在受控攻击、真实GUI截图及代理行为轨迹上,组合防护始终优于单一通道。结果表明,CUA安全不仅需改进动作生成,还需独立验证代理所认为的点击目标及其动机。相关模型、基准与代码已开源。

原文摘要 · Abstract (English)

Computer-using agents (CUAs) act directly on graphical user interfaces, yet their perception of the screen is often unreliable. Existing work largely treats these failures as performance limitations, asking whether an action succeeds, rather than whether the agent is acting on the correct object at all. We argue that this is fundamentally a security problem. We formalize the visual confused deputy: a failure mode in which an agent authorizes an action based on a misperceived screen state, due to grounding errors, adversarial screenshot manipulation, or time-of-check-to-time-of-use (TOCTOU) races. This gap is practically exploitable: even simple screen-level manipulations can redirect routine clicks into privileged actions while remaining indistinguishable from ordinary agent mistakes. To mitigate this threat, we propose the first guardrail that operates outside the agent's perceptual loop. Our method, dual-channel contrastive classification, independently evaluates (1) the visual click target and (2) the agent's reasoning about the action against deployment-specific knowledge bases, and blocks execution if either channel indicates risk. The key insight is that these two channels capture complementary failure modes: visual evidence detects target-level mismatches, while textual reasoning reveals dangerous intent behind visually innocuous controls. Across controlled attacks, real GUI screenshots, and agent traces, the combined guardrail consistently outperforms either channel alone. Our results suggest that CUA safety requires not only better action generation, but independent verification of what the agent believes it is clicking and why. Materials are provided\footnote{Model, benchmark, and code: https://github.com/vllm-project/semantic-router}.

计算机使用代理安全防护视觉欺骗双通道验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。