用动作序列提前预警生成式机器人策略的失败,无需额外计算开销。
ActProbe: Action-Space Probe for Early Failure Detection of Generative Robot Policies

- 仅通过单次前向传播提取动作连续性误差与幅度信号。
- 在多个任务上比基线提前12.7%提升检测效果,未见任务上早检准确率领先9.0%。
- 可部署于真实机器人,加速强化学习调优,减少2.9倍环境交互次数。
生成式机器人策略在部署时会不可预测地失败:关键时刻犹豫、偏离任务或执行无法挽回的动作。现有在线故障检测方法要么需要访问策略内部(白盒),要么通过重采样和观测信号引入运行时开销。我们实证分析发现,生成的动作块本身已蕴含强烈故障预示信号。受此启发,提出ActProbe——一种轻量级纯动作空间探测器,仅需单次前向传播获取两个紧凑信号:相邻动作块间的时序一致性误差(TCE)和当前块的动作幅度(ACM)。ActProbe通过任务条件化的LSTM-MLP架构将这些信号映射为每步的故障概率。在多样化的生成式机器人策略与基准测试中,ActProbe能提前于视觉可识别阶段发出警报,平均提升故障检测准确率(F1)-及时性帕累托前沿12.7%的超体积增益,且在未见任务上早检ROC-AUC领先9.0%。该方法还可迁移至真实机器人部署,在未见抓取任务中成功预测故障,并使强化学习微调(PPO)效率提升2.9倍,减少2.9倍环境交互次数。
原文摘要 · Abstract (English)
Generative robot policies fail unpredictably at deployment: they hesitate at critical moments, drift off-task, or commit to unrecoverable actions. Existing online failure detectors either require white-box access to policy internals or add runtime overhead through resampling and observation-side signals. Our empirical analysis shows that emitted action chunks themselves already carry strong predictive signal for impending failures in generative robot policies. Motivated by this observation, we introduce ActProbe, a lightweight, pure action-space detector that uses two compact signals available from a single forward pass: Temporal Consistency Error (TCE) between consecutive action chunks and Action Chunk Magnitude (ACM) of the current chunk. ActProbe maps these signals to per-step failure probabilities with a task-conditioned LSTM-MLP architecture. Across a diverse suite of generative robot policies and benchmarks, ActProbe raises alerts before failures become visually recognizable, improving the accuracy (F1)-timeliness Pareto frontier of failure detection by an average hypervolume gain of +12.7% over both internal- and external-feature baselines, with a +9.0% early-detection ROC-AUC lead on unseen tasks. ActProbe further transfers to deployment, predicting failures on unseen real-robot pick tasks and accelerating RL fine-tuning (PPO) with 2.9x fewer environment interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。