arXiv:2510.09459cs.ROcs.AI2025-10NeurIPS被引 32

无需失败数据,实时预测生成式机器人策略的故障。

Failure Prediction at Runtime for Generative Robot Policies

  • 通过嵌入空间中的分布外检测和动作熵评分双重指标预警故障。
  • 在5个仿真与真实环境测试中,提前且准确识别故障,误报率更低。
  • 适合需安全部署的机器人场景,尤其对无失败数据的系统有帮助。

基于扩散和流匹配等生成模型的模仿学习(IL)已使机器人能够执行复杂、长时程任务。然而,未见环境下的分布偏移或动作误差累积仍可能导致不可预测且不安全的行为,引发任务失败。因此,运行时早期故障预测对人机共存及高安全要求场景至关重要。我们提出FIPER——一种适用于生成式模仿学习策略的运行时故障预测通用框架,无需失败数据。FIPER识别两个关键故障前兆:(i) 通过随机网络蒸馏在策略嵌入空间中检测分布外(OOD)观测;(ii) 通过新颖的动作块熵评分衡量生成动作的高不确定性。两个预测分数均通过少量成功轨迹进行分位数校准。当两者在短时间窗内同时超过阈值时触发故障警报。我们在五个包含多种故障模式的仿真与真实环境中评估FIPER,结果表明其能更优地区分真实故障与良性分布外情况,且比现有方法更早、更准确地预测故障。本工作为提升生成式机器人策略的可解释性与安全性迈出重要一步。代码、数据与视频见https://tum-lsy.github.io/fiper_website。

原文摘要 · Abstract (English)

Imitation learning (IL) with generative models, such as diffusion and flow matching, has enabled robots to perform complex, long-horizon tasks. However, distribution shifts from unseen environments or compounding action errors can still cause unpredictable and unsafe behavior, leading to task failure. Early failure prediction during runtime is therefore essential for deploying robots in human-centered and safety-critical environments. We propose FIPER, a general framework for Failure Prediction at Runtime for generative IL policies that does not require failure data. FIPER identifies two key indicators of impending failure: (i) out-of-distribution (OOD) observations detected via random network distillation in the policy's embedding space, and (ii) high uncertainty in generated actions measured by a novel action-chunk entropy score. Both failure prediction scores are calibrated using a small set of successful rollouts via conformal prediction. A failure alarm is triggered when both indicators, aggregated over short time windows, exceed their thresholds. We evaluate FIPER across five simulation and real-world environments involving diverse failure modes. Our results demonstrate that FIPER better distinguishes actual failures from benign OOD situations and predicts failures more accurately and earlier than existing methods. We thus consider this work an important step towards more interpretable and safer generative robot policies. Code, data and videos are available at https://tum-lsy.github.io/fiper_website.

机器人故障预测生成模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。