arXiv:2608.24174cs.AI2026-08

为GUI任务设计自适应评分标准,提升奖励模型准确性

Task-Adaptive Rubrics for GUI Reward Modeling

论文配图:Task-Adaptive Rubrics for GUI Reward Modeling
图 1 · 摘自论文原文
  • 分两阶段构建任务自适应评分:先按类别查通用标准,再针对具体指令生成细节约束
  • 在相同图像预算下,相比基线提升F1值3.6点,任务成功率提高4.23点
  • 适合需要精准理解用户指令的GUI自动化系统开发者

近年来,GUI智能体研究聚焦于结果奖励建模,通过判断执行轨迹是否满足用户指令隐含的成功条件来分配奖励。然而,现有GUI奖励验证器在构建这些条件时往往缺乏任务适应性:或使用通用评分结构,或依赖模型隐式推理,导致跨任务迁移检查、忽略当前指令的具体约束,或因未明说的要求而过于严格。为此,我们提出AdaptRubric——一种从粗到细的评分框架,通过类别级粗粒度检索与实例级细粒度生成,构建任务自适应的判断标准。该方法先将指令路由至GUI任务族并检索可复用的任务族标准,再生成紧凑线索以提取当前指令中的具体数值、范围和约束。在离线奖励评估与在线强化学习优化中,AdaptRubric持续优于先前奖励代理,在匹配图像预算下,相比基线平均提升F1 3.6点,并带来4.23点的任务成功率增益。

原文摘要 · Abstract (English)

Recent studies on GUI agents have increasingly focused on outcome reward modeling, which assigns outcome rewards by judging whether an executed trajectory satisfies the success criteria implied by the user instruction. Existing GUI reward verifiers, however, often under-specify how these criteria should be constructed for each task instance. Whether using generic rubric structures or implicit model reasoning, their judging criteria are not sufficiently task-adaptive: they can transfer checks across tasks, overlook concrete constraints in the current instruction, or become overly strict by enforcing unstated requirements. To address this limitation, we propose AdaptRubric, a Coarse-to-Fine Rubrics Framework that constructs task-adaptive judging criteria through a category-level coarse stage and an instance-level fine stage. AdaptRubric performs category-level coarse rubric retrieval by routing the instruction to a GUI task family and retrieving reusable task-family criteria, then conducts instance-level fine rubric generation to surface compact cues for concrete values, scopes, and constraints in the current instruction. Across offline reward evaluation and online reinforcement learning optimization, AdaptRubric consistently outperforms prior reward agents, improving F1 by 3.6 points over the baseline average under a matched image budget and yielding a 4.23-point task-success gain.

GUI自动化奖励建模自适应评分

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。