arXiv:2601.15876cs.AI2026-01被引 38

通过自演化生成海量模拟经验,让电脑操作智能体学会复杂任务。

EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

  • 构建自洽演化的学习循环,边生成任务边优化策略。
  • 在OSWorld上达56.7%成功率,超越开源与闭源模型。
  • 适合研究通用智能体、自主学习系统的开发者参考。

开发原生电脑使用智能体(CUA)是多模态AI的重要进展,但受限于静态数据的扩展性。现有依赖被动模仿静态数据集的方法难以捕捉长期任务中的复杂因果关系。本文提出EvoCUA,一种原生电脑使用代理模型。不同于静态模仿,EvoCUA将数据生成与策略优化整合为自维持的演化循环。为缓解数据稀缺,我们设计可验证的合成引擎,自动生成多样化任务并配备可执行验证器;为实现大规模经验获取,构建支持数万异步沙盒回放的可扩展基础设施。基于这些大规模轨迹,提出迭代演化学习策略,通过识别能力边界动态调控策略更新:强化成功行为,将失败轨迹转化为丰富监督信号,经错误分析与自我修正。在OSWorld基准测试中,EvoCUA取得56.7%的成功率,创下开源新纪录。显著优于此前最佳开源模型OpenCUA-72B(45.0%),并超越领先闭源模型UI-TARS-2(53.1%)。结果表明,该演化范式具备良好泛化性:无论基础模型规模如何,均能持续提升性能,为原生智能体能力的推进提供稳健且可扩展的路径。

原文摘要 · Abstract (English)

The development of native computer-use agents (CUA) represents a significant leap in multimodal AI. However, their potential is currently bottlenecked by the constraints of static data scaling. Existing paradigms relying primarily on passive imitation of static datasets struggle to capture the intricate causal dynamics inherent in long-horizon computer tasks. In this work, we introduce EvoCUA, a native computer use agentic model. Unlike static imitation, EvoCUA integrates data generation and policy optimization into a self-sustaining evolutionary cycle. To mitigate data scarcity, we develop a verifiable synthesis engine that autonomously generates diverse tasks coupled with executable validators. To enable large-scale experience acquisition, we design a scalable infrastructure orchestrating tens of thousands of asynchronous sandbox rollouts. Building on these massive trajectories, we propose an iterative evolving learning strategy to efficiently internalize this experience. This mechanism dynamically regulates policy updates by identifying capability boundaries -- reinforcing successful routines while transforming failure trajectories into rich supervision through error analysis and self-correction. Empirical evaluations on the OSWorld benchmark demonstrate that EvoCUA achieves a success rate of 56.7%, establishing a new open-source state-of-the-art. Notably, EvoCUA significantly outperforms the previous best open-source model, OpenCUA-72B (45.0%), and surpasses leading closed-weights models such as UI-TARS-2 (53.1%). Crucially, our results underscore the generalizability of this approach: the evolving paradigm driven by learning from experience yields consistent performance gains across foundation models of varying scales, establishing a robust and scalable path for advancing native agent capabilities.

智能体自演化经验生成电脑操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。