无需失败数据,通过不确定性感知实现机器人模仿学习的实时故障检测。
Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policies
- 将故障检测转化为序列异常分布识别,仅用成功数据提取关键信号。
- 在多种任务上检测准确率优于现有方法,且推理速度更快。
- 适合需要高安全性的机器人部署场景,尤其适用于缺乏失败数据的系统。
近年来,基于模仿学习与生成建模(如扩散模型、流模型)的机器人操作系统取得显著进展。随着任务复杂度和时间跨度增加,出现难以预知的多样化故障模式。为保障在安全关键的人类环境中可靠部署,运行时故障检测至关重要。然而,多数现有方法依赖已知故障模式和训练阶段的失败数据,实用性与可扩展性受限。为此,我们提出FAIL-Detect,一种模块化的两阶段故障检测框架。通过将策略输入输出映射为与故障相关的标量信号,并捕捉认知不确定性,将问题建模为序列异常分布检测。该方法采用置信预测(CP)进行不确定性量化,具备统计保证。我们在多样化的机器人操作任务中评估了学习型与后验型标量信号,结果表明学习型信号普遍有效,尤其结合新型流模型密度估计器时表现更优。实验显示,该方法在检测准确性和速度上均优于当前最优基准,展现了提升模仿学习系统安全性与可靠性的潜力。
原文摘要 · Abstract (English)
Recent years have witnessed impressive robotic manipulation systems driven by advances in imitation learning and generative modeling, such as diffusion- and flow-based approaches. As robot policy performance increases, so does the complexity and time horizon of achievable tasks, inducing unexpected and diverse failure modes that are difficult to predict a priori. To enable trustworthy policy deployment in safety-critical human environments, reliable runtime failure detection becomes important during policy inference. However, most existing failure detection approaches rely on prior knowledge of failure modes and require failure data during training, which imposes a significant challenge in practicality and scalability. In response to these limitations, we present FAIL-Detect, a modular two-stage approach for failure detection in imitation learning-based robotic manipulation. To accurately identify failures from successful training data alone, we frame the problem as sequential out-of-distribution (OOD) detection. We first distill policy inputs and outputs into scalar signals that correlate with policy failures and capture epistemic uncertainty. FAIL-Detect then employs conformal prediction (CP) as a versatile framework for uncertainty quantification with statistical guarantees. Empirically, we thoroughly investigate both learned and post-hoc scalar signal candidates on diverse robotic manipulation tasks. Our experiments show learned signals to be mostly consistently effective, particularly when using our novel flow-based density estimator. Furthermore, our method detects failures more accurately and faster than state-of-the-art (SOTA) failure detection baselines. These results highlight the potential of FAIL-Detect to enhance the safety and reliability of imitation learning-based robotic systems as they progress toward real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。