RAPT实时检测机器人仿真到现实迁移中的异常,精准定位失败时刻与原因。
RAPT: Model-Predictive Out-of-Distribution Detection and Failure Diagnosis for Sim-to-Real Humanoid Deployment
- 基于自监督学习构建轻量级轨迹预测模型,每秒50次在线监测
- 在硬件测试中实现89%的真阳性率,误报率低于同类方法
- 结合语义推理实现零样本故障归因,准确率达75%
将学习到的控制策略部署到真实世界存在风险,因为仿真中表现稳健的策略在仿真到现实迁移后可能自信地进入分布外(OOD)状态,导致无声故障和潜在硬件损坏。现有异常检测器常无法满足高频控制、极低误报率及可解释性反馈的需求。本文提出轻量级自监督模型 RAPT(Recurrent Anomaly Probabilistic Trajectory Model),以50赫兹频率在部署时持续监测,从大规模仿真中学习正常行为模式,实时生成逐维度的预测偏差信号。RAPT 在严格误报率约束下实现分布外检测,并定位真实执行偏离正常行为的时间与位置。事后诊断方面,结合时间显著性、关节运动学摘要与大模型语义推理,在零样本场景下分类可能的故障原因。在四个 Isaac Lab 任务的仿真中,当每集误报率控制在0.5%时,其真阳性率比最强基线提升37%;在硬件上,78次试验中达到89%真阳性率,且误报少于兼容高频的基线;在具有挑战性的分布外子集上,对21类故障的语义诊断准确率达75%。
原文摘要 · Abstract (English)
Deploying learned control policies is risky because policies that appear robust in simulation can confidently enter out-of-distribution (OOD) states after Sim-to-Real transfer, causing silent failures and potential hardware damage. Existing anomaly detectors often fail to meet the requirements of high-rate control, extremely low false-positive rates, and interpretable failure feedback. We present \textbf{RAPT} (Recurrent Anomaly Probabilistic Trajectory Model), a lightweight, self-supervised $50$\,Hz deployment monitor that learns nominal execution from large-scale simulation and produces calibrated, per-dimension predictive-deviation signals online. RAPT enables OOD detection under strict false-positive constraints while localizing \emph{when and where} real execution departs from nominal behavior. For post-hoc diagnosis, RAPT combines temporal saliency, joint-kinematic summaries, and LLM-based semantic reasoning to classify likely failure causes in a zero-shot setting. In simulation across four Isaac Lab tasks, RAPT improves TPR by $37\%$ over the strongest baseline at $0.5\%$ episode-level FPR; on hardware, it achieves $89\%$ TPR across $78$ trials with fewer false positives than high-frequency-compatible baselines, and reaches $75\%$ semantic failure diagnosis accuracy across $21$ categories on a challenging OOD subset. Project website, code, and videos: https://humphreymunn.github.io/RAPT/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。