通过自动生成可验证任务与高效强化学习,大幅提升电脑操作智能体的自动化能力。
SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL

- 自动生成24000+可验证任务,支持百个智能体并行训练
- 新算法使训练速度提升2.83倍,开源模型在两大数据集上达68.7%和54.0%
- 适合研究自动化工作流、智能体训练效率的开发者与研究员
电脑使用智能体(CUAs)正成为通过视觉感知与图形界面执行实现复杂数字流程自动化的有力工具。在线强化学习结合可验证奖励(RLVR)是扩展其能力的关键方向,但受限于可验证数据稀缺与在线强化学习效率低下。为此,我们提出ScaleCUA统一框架,通过可验证任务生成与高效训练实现线上强化学习的规模化。在数据层面,设计了端到端的VeriGen框架,通过迭代Docker交互与多智能体反馈环生成可验证任务;通过共享Docker交互探针实现100+并发智能体,生成超过24,000个可验证任务及近3,000个高质量强化学习任务。为提升样本效率,提出前沿采样(Frontier Sampling),追踪每项任务能力并分配回放至当前学习前沿。在训练层面,设计视觉上下文分割机制,以滑动窗口处理近期视觉上下文,在平衡推理与训练压力的同时,相比逐步分解方法实现2.83倍训练加速。最终,ScaleCUA在OSWorld上达到68.7%,在ScienceBoard上达到54.0%,刷新开源电脑使用智能体性能纪录。代码、模型与数据集已开源:https://github.com/THUDM/SCALE-CUA。
原文摘要 · Abstract (English)
Computer use agents (CUAs) are emerging as a powerful interface for automating complex digital workflows through visual perception and GUI execution. Online reinforcement learning with verifiable rewards (RLVR) has emerged as a key direction for scaling their capabilities. However, this paradigm is bottlenecked by verifiable data scarcity and online RL inefficiency. To break these barriers, we introduce ScaleCUA, a unified framework that scales online RL for CUAs via verifiable task synthesis and efficient training. At the data level, we design VeriGen, an end-to-end framework for generating verifiable RL tasks through iterative docker interactions and a multi-agent feedback loop. Scaled to 100+ concurrent agent workers via a shared docker interaction probe, this pipeline produces 24K+ verifiable tasks and nearly 3K high-quality RL tasks. To maximize sample efficiency, we propose Frontier Sampling, which tracks per-task capability and allocates rollouts to the current learning frontier. On the training side, we further design Visual Context Segmentation, a sliding window over recent visual context that balances rollout and training-engine pressure, yielding a 2.83x training speedup over step-wise decomposition. Together, ScaleCUA achieves 68.7% on OSWorld and 54.0% on ScienceBoard, establishing new state-of-the-art performance among open-source computer use agents. Code, models, and datasets are available at https://github.com/THUDM/SCALE-CUA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。