arXiv:2509.25047cs.AI2025-09被引 15

用自动探索生成海量可执行的交互任务,让AI助手更智能。

Scaling Synthetic Task Generation for Agents via Exploration

  • 通过自动探索环境发现新状态,生成真实可用的任务
  • 在20个安卓应用中生成2万条任务,成功率提升20%
  • 适合训练手机和电脑操作类AI Agent,减少人工标注

后训练多模态大语言模型(MLLM)构建交互式智能体在计算机使用、网页导航和机器人等领域前景广阔。然而,规模化后训练的关键挑战在于缺乏高质量、多样、可执行且可验证的下游任务数据集。现有任务生成方法严重依赖人工标注或仅基于有限环境信息提示MLLM,导致成本高或覆盖范围小。为此,我们提出AutoPlay,一个可扩展的任务生成流水线,通过显式探索交互环境,发现可能的交互行为与当前状态信息,从而合成环境感知的任务。AutoPlay分为两个阶段:(i) 探索阶段,由MLLM探索代理系统性地发现新环境状态与功能;(ii) 任务生成阶段,任务生成器利用探索轨迹和一组任务指导提示作为上下文,合成多样化、可执行且可验证的任务。我们展示AutoPlay在20个Android应用中生成2万条任务,在13个Ubuntu应用中生成1万条任务,用于训练移动端和计算机端智能体。借助MLLM任务执行器与验证器,无需人工标注即可实现大规模任务演示合成。该数据使基于MLLM的UI智能体在移动端成功率达20.0%,在计算机端达10.9%。此外,结合MLLM验证器奖励机制,可扩展强化学习训练,带来额外5.7%的性能提升。结果表明,AutoPlay是一种可扩展的后训练方法,显著降低对人工标注的依赖。

原文摘要 · Abstract (English)

Post-Training Multimodal Large Language Models (MLLMs) to build interactive agents holds promise across domains such as computer-use, web navigation, and robotics. A key challenge in scaling such post-training is lack of high-quality downstream agentic task datasets with tasks that are diverse, feasible, and verifiable. Existing approaches for task generation rely heavily on human annotation or prompting MLLM with limited downstream environment information, which is either costly or poorly scalable as it yield tasks with limited coverage. To remedy this, we present AutoPlay, a scalable pipeline for task generation that explicitly explores interactive environments to discover possible interactions and current state information to synthesize environment-grounded tasks. AutoPlay operates in two stages: (i) an exploration phase, where an MLLM explorer agent systematically uncovers novel environment states and functionalities, and (ii) a task generation phase, where a task generator leverages exploration trajectories and a set of task guideline prompts as context to synthesize diverse, executable, and verifiable tasks. We show AutoPlay generates 20k tasks across 20 Android applications and 10k tasks across 13 applications Ubuntu applications to train mobile-use and computer-use agents. AutoPlay generated tasks enable large-scale task demonstration synthesis without human annotation by employing an MLLM task executor and verifier. This data enables training MLLM-based UI agents that improve success rates up to $20.0\%$ on mobile-use and $10.9\%$ on computer-use scenarios. In addition, AutoPlay generated tasks combined with MLLM verifier-based rewards enable scaling reinforcement learning training of UI agents, leading to an additional $5.7\%$ gain. coverage. These results establish AutoPlay as a scalable approach for post-training capable MLLM agents reducing reliance on human annotation.

任务生成AI代理自动化探索大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。