arXiv:2603.21669cs.ROcs.CV2026-03被引 5

用过程奖励模型评估机器人执行细节,揭示传统成功率忽略的性能问题

PRM-as-a-Judge: A Dense Evaluation Paradigm for Fine-Grained Robotic Auditing

  • 通过轨迹视频直接分析任务进展,用过程奖励模型实现细粒度评估
  • 在RoboPulse基准上,PRM模型比相似度方法更敏感,能区分微小进度差异
  • 可发现长程任务中隐藏的行为缺陷,适合研究机器人策略优化的学者

当前机器人评估仍以二元成败率为主,将复杂的执行过程压缩为单一结果,掩盖了进展、效率与稳定性等关键质量。为此,我们提出PRM-as-a-Judge,一种基于过程奖励模型(PRM)的密集评估范式,通过从轨迹视频中估计观察序列的任务进展,直接审计策略执行。核心是OPD(结果-过程-诊断)指标体系,以任务对齐的进展势能显式形式化执行质量。该范式具备两个公理性质:宏观一致性(加法性与路径一致)和微观分辨率(对细微物理演进敏感)。基于势能的PRM判官自然满足宏观一致性,且在专为探测微尺度进展区分能力设计的RoboPulse基准上,多个轨迹训练的PRM判官优于基于判别相似性的方法和通用基础模型判官。最后,结合PRM-as-a-Judge与OPD体系,我们对主流策略范式在长时任务中进行了结构化审计,揭示了仅凭结果指标无法观测的行为特征与失败模式。

原文摘要 · Abstract (English)

Current robotic evaluation is still largely dominated by binary success rates, which collapse rich execution processes into a single outcome and obscure critical qualities such as progress, efficiency, and stability. To address this limitation, we propose PRM-as-a-Judge, a dense evaluation paradigm that leverages Process Reward Models (PRMs) to audit policy execution directly from trajectory videos by estimating task progress from observation sequences. Central to this paradigm is the OPD (Outcome-Process-Diagnosis) metric system, which explicitly formalizes execution quality via a task-aligned progress potential. We characterize dense robotic evaluation through two axiomatic properties: macro-consistency, which requires additive and path-consistent aggregation, and micro-resolution, which requires sensitivity to fine-grained physical evolution. Under this formulation, potential-based PRM judges provide a natural instantiation of dense evaluation, with macro-consistency following directly from the induced scalar potential. We empirically validate the micro-resolution property using RoboPulse, a diagnostic benchmark specifically designed for probing micro-scale progress discrimination, where several trajectory-trained PRM judges outperform discriminative similarity-based methods and general-purpose foundation-model judges. Finally, leveraging PRM-as-a-Judge and the OPD metric system, we conduct a structured audit of mainstream policy paradigms across long-horizon tasks, revealing behavioral signatures and failure modes that are invisible to outcome-only metrics.

机器人评估过程奖励细粒度分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。