arXiv:2511.22235cs.AI2025-11中稿 · CVPR被引 1

用分阶段反馈强化学习训练调度器,提升长时序GUI自动化任务的规划与状态管理能力。

Training High-Level Schedulers with Execution-Feedback Reinforcement Learning for Long-Horizon GUI Automation

  • 分设协调员与状态追踪器,分别负责任务分解与上下文管理。
  • 在多个长周期任务基准上,系统成功率显著提升。
  • 模块可插拔,适配不同执行器,提升通用性。

大规模视觉语言模型(VLM)的发展推动了GUI智能体的研究,但长时序任务仍面临挑战:单一智能体难以兼顾高层规划与底层执行,存在责任耦合与能力冲突;且缺乏任务状态感知,导致进度丢失。为此,提出一种分阶段执行反馈强化学习算法,不训练统一策略模型,而是专注于高层调度模型的训练。具体设计两个智能体:协调员负责战略规划与任务分解;状态追踪器负责上下文压缩与信息管理,以维持任务状态与连贯性。基于此构建协调员-执行器-状态追踪器(CES)多智能体框架,可与任意底层执行器集成,通过任务调度与状态管理协助其完成长时序任务。在多个长时序任务基准上的实验表明,CES显著增强系统的规划与状态管理能力。进一步分析证实,所训练的高层调度模块具有可泛化性,作为即插即用模块能显著提升各类执行器的长时序任务表现。代码将公开于 https://github.com/hehehahi4/CES。

原文摘要 · Abstract (English)

The rapid development of large vision-language model (VLM) has greatly promoted the research of GUI agent. However, GUI agents still face significant challenges in handling long-horizon tasks. First, single-agent models struggle to balance high-level capabilities and low-level execution capability, facing prevalent issues of responsibility coupling and capability conflicts. Second, agents lack awareness of the task state, leading to progress loss in long-horizon tasks. To address these challenges, we propose a staged execution-feedback reinforcement learning algorithm. Unlike training a unified policy model, we focus on training high-level scheduling models. Specifically, we propose and train two agents: a Coordinator, responsible for the strategic planning and task decomposition; and a State Tracker, responsible for context compression and information management to maintain the task's state and coherence. Based on this, we built the Coordinator-Executor-State Tracker (CES) multi-agent framework, which can be integrated with any low-level Executor model, assisting the Executor in solving long-horizon tasks through task scheduling and state management. Experiments on long-horizon task benchmarks demonstrate that CES significantly enhances the system's planning and state management capabilities. Furthermore, analysis confirms that our trained high-level scheduling module is a generalizable, plug-and-play module that significantly enhances the long-horizon capabilities of various Executors. Code can be available at https://github.com/hehehahi4/CES.

GUI自动化多智能体长时序任务强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。