arXiv:2508.20096cs.CVcs.AI2025-08被引 4

CODA让通用规划与专用执行协同工作,提升科学计算界面自动化性能。

CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning

  • 分两阶段训练:先为每类应用定制专家规划器,再融合轨迹训练统一规划器。
  • 在ScienceBoard上四类任务均超越基线,开源模型中表现最佳。
  • 适合需要长程规划与精准操作的科研自动化场景。

面向科学计算等专业领域的图形用户界面自主代理面临长期规划与精确执行的双重挑战。现有方法存在权衡:通用代理擅长规划但执行差,专用代理则相反。现有组合框架多为静态不可训练,难以从经验中优化,而科学领域高质量数据稀缺。为此,我们提出CODA,一种可训练的组合框架,将通用规划器(大脑)与专用执行器(小脑)结合,采用双阶段训练流程。第一阶段‘专化’中,基于少量任务轨迹,通过解耦的GRPO方法为每个科学应用单独训练专家规划器;第二阶段‘泛化’中,聚合各专家成功轨迹构建综合数据集,用于监督微调最终规划器。该设计使CODA兼具强执行能力与跨域泛化性。在ScienceBoard基准的四个挑战性任务上,CODA显著优于基线,成为开源模型中的新SOTA。

原文摘要 · Abstract (English)

Autonomous agents for Graphical User Interfaces (GUIs) face significant challenges in specialized domains such as scientific computing, where both long-horizon planning and precise execution are required. Existing approaches suffer from a trade-off: generalist agents excel at planning but perform poorly in execution, while specialized agents demonstrate the opposite weakness. Recent compositional frameworks attempt to bridge this gap by combining a planner and an actor, but they are typically static and non-trainable, which prevents adaptation from experience. This is a critical limitation given the scarcity of high-quality data in scientific domains. To address these limitations, we introduce CODA, a novel and trainable compositional framework that integrates a generalist planner (Cerebrum) with a specialist executor (Cerebellum), trained via a dedicated two-stage pipeline. In the first stage, Specialization, we apply a decoupled GRPO approach to train an expert planner for each scientific application individually, bootstrapping from a small set of task trajectories. In the second stage, Generalization, we aggregate all successful trajectories from the specialized experts to build a consolidated dataset, which is then used for supervised fine-tuning of the final planner. This equips CODA with both robust execution and cross-domain generalization. Evaluated on four challenging applications from the ScienceBoard benchmark, CODA significantly outperforms baselines and establishes a new state of the art among open-source models.

AI代理科学计算强化学习双脑架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。