用流模型实时检测机器人操作异常,提升动态环境下的可靠性。
RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation
- 基于条件归一化流,分离处理机器人与物体的状态信息
- 仅需正样本训练,推理时通过概率密度计算异常得分
- 支持实时响应(<100毫秒),可嵌入现有机器人系统
视觉-语言-动作(VLA)模型使机器人能执行复杂任务,但通过模仿学习训练的VLA模型在动态环境中易失效,尤其在分布外(OOD)条件下。为此,我们提出机器人条件归一化流(RC-NF),一种用于机器人异常检测与干预的实时监控模型,确保机器人状态与物体运动轨迹符合任务要求。RC-NF在归一化流中解耦任务感知的机器人与物体状态处理,仅需正样本进行无监督训练,并通过概率密度函数在推理时生成精确的异常评分。我们进一步构建了LIBERO-Anomaly-10基准,包含三类机器人异常,用于仿真评估。相比以往方法,RC-NF在所有异常类型上均达到最优性能。真实世界实验表明,RC-NF可作为即插即用模块集成至VLA模型(如pi0),提供实时的OOD信号,在必要时实现状态级回滚或任务级重规划,响应延迟低于100毫秒。结果证明,RC-NF显著提升了基于VLA的机器人系统在动态环境中的鲁棒性与适应性。
原文摘要 · Abstract (English)
Recent advances in Vision-Language-Action (VLA) models have enabled robots to execute increasingly complex tasks. However, VLA models trained through imitation learning struggle to operate reliably in dynamic environments and often fail under Out-of-Distribution (OOD) conditions. To address this issue, we propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention that ensures the robot's state and the object's motion trajectory align with the task. RC-NF decouples the processing of task-aware robot and object states within the normalizing flow. It requires only positive samples for unsupervised training and calculates accurate robotic anomaly scores during inference through the probability density function. We further present LIBERO-Anomaly-10, a benchmark comprising three categories of robotic anomalies for simulation evaluation. RC-NF achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks. Real-world experiments demonstrate that RC-NF operates as a plug-and-play module for VLA models (e.g., pi0), providing a real-time OOD signal that enables state-level rollback or task-level replanning when necessary, with a response latency under 100 ms. These results demonstrate that RC-NF noticeably enhances the robustness and adaptability of VLA-based robotic systems in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。