arXiv:2410.21736cs.RO2024-10被引 7

用可达性分析增强视觉控制器的安全性,识别并防范系统级故障。

Enhancing Safety and Robustness of Vision-Based Controllers via Reachability Analysis

  • 通过神经可达管逼近反向可达集,挖掘视觉控制器的失效模式。
  • 在线检测系统级故障并触发备用控制器,离线用故障数据增量训练提升鲁棒性。
  • 在自主飞机滑行任务中验证,优于依赖预测误差或不确定性量化的方法。

自主系统如自动驾驶汽车和无人机近年来利用视觉输入与机器学习实现决策与控制,取得显著进展。然而,面对新奇或分布外输入时,这些视觉控制器可能产生错误预测,导致系统级故障并危及安全。本文提出计算神经可达管,作为反向可达集的参数化近似,用于压力测试视觉控制器并挖掘其失效模式。所识别的故障被用于通过离线与在线两种方法增强系统安全:在线方法训练分类器作为运行时故障监测器,检测闭环系统级故障后触发鲁棒的备用控制器;离线方法则通过精心增强的故障数据集对原控制器进行增量训练,使其对已知失效模式更具鲁棒性。两种方法均能防范超越视觉控制器本身的系统级安全隐患。我们在涉及视觉控制器引导飞机对准跑道中心线的自主滑行任务上验证了该方法的有效性,结果表明其在识别与处理系统级故障方面优于依赖控制器预测误差或不确定性量化的现有方法。

原文摘要 · Abstract (English)

Autonomous systems, such as self-driving cars and drones, have made significant strides in recent years by leveraging visual inputs and machine learning for decision-making and control. Despite their impressive performance, these vision-based controllers can make erroneous predictions when faced with novel or out-of-distribution inputs. Such errors can cascade into catastrophic system failures and compromise system safety. In this work, we compute Neural Reachable Tubes, which act as parameterized approximations of Backward Reachable Tubes to stress-test the vision-based controllers and mine their failure modes. The identified failures are then used to enhance the system safety through both offline and online methods. The online approach involves training a classifier as a run-time failure monitor to detect closed-loop, system-level failures, subsequently triggering a fallback controller that robustly handles these detected failures to preserve system safety. For the offline approach, we improve the original controller via incremental training using a carefully augmented failure dataset, resulting in a more robust controller that is resistant to the known failure modes. In either approach, the system is safeguarded against shortcomings that transcend the vision-based controller and pertain to the closed-loop safety of the overall system. We validate the proposed approaches on an autonomous aircraft taxiing task that involves using a vision-based controller to guide the aircraft towards the centerline of the runway. Our results show the efficacy of the proposed algorithms in identifying and handling system-level failures, outperforming methods that rely on controller prediction error or uncertainty quantification for identifying system failures.

视觉控制安全增强可达性分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。