提出分层注意力增强机制,有效防御界面弹窗攻击
LaSM: Layer-wise Scaling Mechanism for Defending Pop-up Attack on GUI Agents
- 通过分析模型各层注意力差异,识别关键防御层
- 在不重新训练下提升防御成功率至92.3%,误判率降41%
- 适合开发视觉交互类AI系统的安全防护人员
基于多模态大语言模型的图形用户界面代理虽具备强大决策能力,但仍易受弹窗式环境注入攻击影响,恶意视觉元素会误导模型注意力导致错误行为。现有防御方法或需昂贵重训,或在诱导干扰下表现不佳。本文系统研究攻击如何改变代理注意力行为,发现正确与错误输出间存在分层注意力偏离模式。据此提出分层缩放机制(LaSM),选择性增强关键层的注意力与MLP模块,提升模型显著性与任务相关区域的一致性,无需额外训练。跨多个数据集的实验证明,该方法显著提高防御成功率,鲁棒性强,对模型通用能力影响微乎其微。研究揭示注意力错位是多模态大模型代理的核心脆弱点,可通过选择性分层调节有效缓解。代码已开源。
原文摘要 · Abstract (English)
Graphical user interface (GUI) agents built on multimodal large language models (MLLMs) have recently demonstrated strong decision-making abilities in screen-based interaction tasks. However, they remain highly vulnerable to pop-up-based environmental injection attacks, where malicious visual elements divert model attention and lead to unsafe or incorrect actions. Existing defense methods either require costly retraining or perform poorly under inductive interference. In this work, we systematically study how such attacks alter the attention behavior of GUI agents and uncover a layer-wise attention divergence pattern between correct and incorrect outputs. Based on this insight, we propose \textbf{LaSM}, a \textit{Layer-wise Scaling Mechanism} that selectively amplifies attention and MLP modules in critical layers. LaSM improves the alignment between model saliency and task-relevant regions without additional training. Extensive experiments across multiple datasets demonstrate that our method significantly improves the defense success rate and exhibits strong robustness, while having negligible impact on the model's general capabilities. Our findings reveal that attention misalignment is a core vulnerability in MLLM agents and can be effectively addressed through selective layer-wise modulation. Our code can be found in https://github.com/YANGTUOMAO/LaSM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。