让移动代理在不生成长文本推理的情况下,高效完成多步操作。
MIRAGE: Mobile Agents with Implicit Reasoning and Generative World Models

- 用隐式潜空间替代显式推理链,压缩思考过程
- 在AndroidWorld上减少3-5倍解码词数,准确率持平
- 适合追求低延迟、高效率的移动端智能体应用
移动代理需从截图和语言指令中执行日常任务,可靠控制依赖于对界面可操作性的推理、多步导航及未来状态预测。但现有方法依赖长文本思维链,导致交互慢、标注成本高、部署复杂。我们提出MIRAGE框架,从可见的文本推理轨迹中学习连续潜变量表示。该框架将显式推理转化为紧凑隐藏状态,使代理可在内部进行隐式推理,无需生成长推理文本。同时引入生成式世界模型目标:潜变量与未来截图对齐,促使代理在行动前预测界面变化。这使隐式计算兼具压缩思维表征与前瞻环境建模双重功能。推理时,MIRAGE在连续潜空间中完成推理,显著降低词元生成量。在AndroidWorld上,4B模型规模下性能媲美显式思维链微调,解码词预算降低3-5倍,并优于同类指令调优基线10.2分;在AndroidControl上提升动作定位精度,同时生成超过75%更少的词元。
原文摘要 · Abstract (English)
Mobile agents are increasingly expected to operate everyday applications from screenshots and language goals, where reliable control requires reasoning over screen affordances, multi-step navigation, and future state changes. However, many agents externalize this computation as long textual chains of thought, which slows interaction, increases supervision cost, and complicates deployment. We introduce MIRAGE, a framework that learns continuous latent reasoning representations from visible textual reasoning traces. MIRAGE transfers explicit reasoning into compact hidden states, enabling the agent to reason internally without decoding long rationales. It also incorporates a generative world-model objective: latent reasoning vectors are aligned with future screenshots, encouraging the agent to anticipate upcoming interface states before acting. This turns hidden computation into both a compressed thought representation and a forward-looking model of environment dynamics. At inference time, MIRAGE reasons in continuous latent space, reducing token generation while improving execution efficiency. On AndroidWorld, MIRAGE matches explicit chain-of-thought supervised fine-tuning in the 4B ablation with a 3-5x lower decoded-token budget and improves a comparable instruction-tuned baseline by 10.2 points; on AndroidControl, it improves action grounding while generating over 75% fewer tokens.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。