arXiv:2602.22190cs.LGcs.AI2026-02被引 11

通过精准数据与动作感知训练,提升无源GUI智能体的长程任务能力。

GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RL

  • 构建81K动作对齐的推理数据集,解决高质量数据稀缺问题。
  • 引入动作感知SFT和KL正则化,改善推理与操作的对齐性。
  • 适合研究高效推理型界面代理的开发者,无需在线收集数据。

开源原生GUI智能体在长程导航任务上仍落后于闭源系统,主要受限于高质量、动作对齐的推理数据不足,以及通用后训练流程忽视了GUI代理的独特挑战。我们识别出两大核心问题:(i) 标准思维链(CoT)监督微调常损害任务定位准确性;(ii) 步骤式强化学习验证(RLVR)面临部分可验证性,即多个动作可能正确,但仅一个示范动作用于验证,导致离线评估指标难以预测线上任务成功。为此,我们提出GUI-Libra,一种定制化训练方案:首先,构建并过滤数据管道,发布一个81K条目的精选GUI推理数据集;其次,提出动作感知微调(action-aware SFT),混合推理-动作与直接动作数据,并重加权令牌以强化动作与定位;第三,揭示了在部分可验证性下KL正则化的重要性,证明KL信任区域对提升离线到线上预测性能至关重要,并引入成功自适应缩放机制,降低不可靠负梯度影响。在多样化的网页与移动平台基准测试中,GUI-Libra持续提升步骤级准确率与端到端任务完成率。结果表明,精心设计的后训练与数据筛选可在不依赖昂贵在线数据的前提下,显著增强任务求解能力。我们已公开数据集、代码与模型,推动高效后训练研究。

原文摘要 · Abstract (English)

Open-source native GUI agents still lag behind closed-source systems on long-horizon navigation tasks. This gap stems from two limitations: a shortage of high-quality, action-aligned reasoning data, and the direct adoption of generic post-training pipelines that overlook the unique challenges of GUI agents. We identify two fundamental issues in these pipelines: (i) standard SFT with CoT reasoning often hurts grounding, and (ii) step-wise RLVR-tyle training faces partial verifiability, where multiple actions can be correct but only a single demonstrated action is used for verification. This makes offline step-wise metrics weak predictors of online task success. In this work, we present GUI-Libra, a tailored training recipe that addresses these challenges. First, to mitigate the scarcity of action-aligned reasoning data, we introduce a data construction and filtering pipeline and release a curated 81K GUI reasoning dataset. Second, to reconcile reasoning with grounding, we propose action-aware SFT that mixes reasoning-then-action and direct-action data and reweights tokens to emphasize action and grounding. Third, to stabilize RL under partial verifiability, we identify the overlooked importance of KL regularization in RLVR and show that a KL trust region is critical for improving offline-to-online predictability; we further introduce success-adaptive scaling to downweight unreliable negative gradients. Across diverse web and mobile benchmarks, GUI-Libra consistently improves both step-wise accuracy and end-to-end task completion. Our results suggest that carefully designed post-training and data curation can unlock significantly stronger task-solving capabilities without costly online data collection. We release our dataset, code, and models to facilitate further research on data-efficient post-training for reasoning-capable GUI agents.

GUI代理推理对齐强化学习数据构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。