arXiv:2604.15093cs.AIcs.CL2026-04被引 9

开源框架OpenMobile生成高质量手机任务指令与轨迹,提升智能体性能。

OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis

论文配图:OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis
图 1 · 摘自论文原文
  • 通过环境记忆构建多样化、有依据的任务指令
  • 采用策略切换生成纠错数据,提升任务鲁棒性
  • 在多个基准上表现优异,适合移动端智能体研究

基于视觉语言模型的移动智能体在自动化手机任务方面已展现强大能力,近期领先模型在AndroidWorld上的成功率接近70%。然而,这些系统训练数据封闭,其任务与轨迹合成方法不透明。我们提出OpenMobile,一个开源框架,通过两个核心组件合成高质量任务指令与智能体轨迹:(1) 可扩展的任务合成流水线,从探索中构建全局环境记忆,并据此生成多样且基于上下文的指令;(2) 策略切换策略用于轨迹回放,通过交替使用学习者和专家模型,捕捉标准模仿学习中常缺失的错误恢复数据。在三个动态移动智能体基准测试中,使用该数据训练的智能体表现优异,其中微调后的Qwen2.5-VL和Qwen3-VL在AndroidWorld上分别达到51.7%和64.7%的成功率,显著超越现有公开数据方法。我们还对合成指令与基准测试集的重叠度进行了透明分析,验证性能提升源于功能覆盖广度而非基准过拟合。代码与数据已公开于https://njucckevin.github.io/openmobile/,旨在弥合数据差距,推动移动端智能体研究发展。

原文摘要 · Abstract (English)

Mobile agents powered by vision-language models have demonstrated impressive capabilities in automating mobile tasks, with recent leading models achieving a marked performance leap, e.g., nearly 70% success on AndroidWorld. However, these systems keep their training data closed and remain opaque about their task and trajectory synthesis recipes. We present OpenMobile, an open-source framework that synthesizes high-quality task instructions and agent trajectories, with two key components: (1) The first is a scalable task synthesis pipeline that constructs a global environment memory from exploration, then leverages it to generate diverse and grounded instructions. and (2) a policy-switching strategy for trajectory rollout. By alternating between learner and expert models, it captures essential error-recovery data often missing in standard imitation learning. Agents trained on our data achieve competitive results across three dynamic mobile agent benchmarks: notably, our fine-tuned Qwen2.5-VL and Qwen3-VL reach 51.7% and 64.7% on AndroidWorld, far surpassing existing open-data approaches. Furthermore, we conduct transparent analyses on the overlap between our synthetic instructions and benchmark test sets, and verify that performance gains stem from broad functionality coverage rather than benchmark overfitting. We release data and code at https://njucckevin.github.io/openmobile/ to bridge the data gap and facilitate broader mobile agent research.

移动智能体任务合成开源框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。