用两种方法实时监控机器人策略,提前发现运行异常和任务停滞。
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress
- 通过动作时序一致性统计检测突发性异常行为
- 利用视觉语言模型识别持续无效操作,提升故障检出率18%
- 适合部署在真实机器人场景中,兼顾效率与可靠性
基于模仿学习训练的机器人行为策略在偏离训练数据条件时易发生失效。为此,我们提出Sentinel框架,在推理阶段对策略进行实时监控,以实现早期故障预警。该框架将故障检测分为两类:一是通过动作时序一致性统计量检测突发性错误行为;二是利用视觉语言模型(VLM)识别策略虽自信但无法推进任务的无效动作。由于学习策略存在多样化的失效模式,结合互补检测器可显著提升故障检出准确率。同时,采用统计时序一致性方法可在极低计算成本下快速捕捉多模态生成策略的异常行为;而仅在非时间敏感场景使用VLM。我们在模拟与真实世界中的扩散策略(diffusion policies)移动操作任务中验证了该方法。结果表明,统一时序一致性检测与VLM监控后,故障检出率比单一检测器提升18%,显著优于基线方法,凸显为不同故障类型分配专用检测器的重要性。定性结果见 https://sites.google.com/stanford.edu/sentinel。
原文摘要 · Abstract (English)
Robot behavior policies trained via imitation learning are prone to failure under conditions that deviate from their training data. Thus, algorithms that monitor learned policies at test time and provide early warnings of failure are necessary to facilitate scalable deployment. We propose Sentinel, a runtime monitoring framework that splits the detection of failures into two complementary categories: 1) Erratic failures, which we detect using statistical measures of temporal action consistency, and 2) task progression failures, where we use Vision Language Models (VLMs) to detect when the policy confidently and consistently takes actions that do not solve the task. Our approach has two key strengths. First, because learned policies exhibit diverse failure modes, combining complementary detectors leads to significantly higher accuracy at failure detection. Second, using a statistical temporal action consistency measure ensures that we quickly detect when multimodal, generative policies exhibit erratic behavior at negligible computational cost. In contrast, we only use VLMs to detect failure modes that are less time-sensitive. We demonstrate our approach in the context of diffusion policies trained on robotic mobile manipulation domains in both simulation and the real world. By unifying temporal consistency detection and VLM runtime monitoring, Sentinel detects 18% more failures than using either of the two detectors alone and significantly outperforms baselines, thus highlighting the importance of assigning specialized detectors to complementary categories of failure. Qualitative results are made available at https://sites.google.com/stanford.edu/sentinel.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。