安卓无障碍功能成漏洞入口,让手机AI代理遭间接提示注入攻击
Not an A11y: How Android Accessibility Exposes Mobile AI Agents to Indirect Prompt Injection

- 利用未过滤的无障碍数据与视觉输入结合,暴露系统性安全风险
- MobileRun攻击成功率0.822,即便在隐藏界面也能劫持目标并执行越权操作
- 适合研究移动AI安全、系统设计或对抗攻击的开发者与安全研究人员
自主AI代理正改变用户与移动设备的交互方式。MobileRun和Mobile-Use等框架通过解析Android无障碍(A11y)树及视觉截图来理解界面并完成多步骤任务。本文揭示,依赖未经清洗的无障碍元数据与视觉输入,使这些框架面临间接提示注入的系统性漏洞。恶意提示可导致代理偏离原目标、突破上下文边界并执行未经授权的操作。实证评估显示,在视觉隐藏与完全暴露场景下均出现目标劫持、上下文漂移和越权行为。总体而言,MobileRun在Gemma4:31B模型下攻击成功率达0.822;Mobile-Use使用Qwen3.6:35B时降至0.150,但仍无法消除上下文漂移与越权操作。结果表明当前移动代理框架未能有效维护语义上下文边界,将被动环境文本误视为可信指令。最后,我们提出攻击分类,并呼吁采用零信任输入验证、专用安全代理和严格上下文隔离机制。
原文摘要 · Abstract (English)
The rise of autonomous AI agents represents a major paradigm shift in how users interact with mobile devices. Frameworks such as MobileRun and Mobile-Use can autonomously navigate Android applications and execute complex multi-step tasks. To interpret user interfaces, these frameworks rely primarily on Android accessibility (A11y) trees and secondarily on visual screenshots. In this paper, we demonstrate that this architectural dependence on unsanitized accessibility metadata, together with visual input, introduces a systemic vulnerability to indirect prompt injection. We show that adversarial prompts can cause autonomous agents to abandon their original objectives, violate context boundaries, and perform unauthorized device actions. Our empirical evaluation demonstrates goal hijacking, context drift, and unauthorized actions across visually hidden and fully exposed attack scenarios. In aggregate, MobileRun reaches an attack success rate of 0.822 with Gemma4:31B, while Mobile-Use with Qwen3.6:35B reduces this to 0.150 but does not eliminate context drift or unauthorized actions. These findings reveal that current mobile agent frameworks fail to enforce semantic context boundaries, treating passive environmental text as trusted instructions. Finally, we present a taxonomy of these attacks and discuss the need for zero-trust input validation, dedicated security agents, and strict context isolation within mobile agent architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。