构建三专家集成系统,自动识别自动驾驶中的异常场景、交互与行为。
An Expert Ensemble for Detecting Anomalous Scenes, Interactions, and Behaviors in Autonomous Driving
- 设计三个无监督专家:场景、交互、行为,分别捕捉不同层面的异常。
- 在真实数据集上优于现有方法,异常检测准确率显著提升。
- 适合自动驾驶安全系统开发人员,尤其关注边缘情况识别的团队。
随着自动驾驶车辆进入公共道路,应对海量驾驶场景的安全问题成为普及的关键挑战。检测超出设计运行域的异常情况是实现可信自动驾驶的核心。由于复杂互动场景的存在,基于车载视角视频的异常检测仍具挑战性。本文通过分析常见异常模式,提出三个无监督异常检测专家:场景专家关注帧级外观与异常运动;交互专家建模道路参与者间的正常相对运动,检测异常交互;行为专家通过未来轨迹预测监测个体对象的异常行为。为融合各模块优势,提出基于卡尔曼滤波的专家集成框架(Xen),将最终异常得分作为状态变量,专家输出作为观测值。实验采用新型评估协议,验证了模型在大规模真实数据集上的优越性能,且具备在无监督学习下分类异常类型的能力。
原文摘要 · Abstract (English)
As automated vehicles enter public roads, safety in a near-infinite number of driving scenarios becomes one of the major concerns for the widespread adoption of fully autonomous driving. The ability to detect anomalous situations outside of the operational design domain is a key component in self-driving cars, enabling us to mitigate the impact of abnormal ego behaviors and to realize trustworthy driving systems. On-road anomaly detection in egocentric videos remains a challenging problem due to the difficulties introduced by complex and interactive scenarios. We conduct a holistic analysis of common on-road anomaly patterns, from which we propose three unsupervised anomaly detection experts: a scene expert that focuses on frame-level appearances to detect abnormal scenes and unexpected scene motions; an interaction expert that models normal relative motions between two road participants and raises alarms whenever anomalous interactions emerge; and a behavior expert which monitors abnormal behaviors of individual objects by future trajectory prediction. To combine the strengths of all the modules, we propose an expert ensemble (Xen) using a Kalman filter, in which the final anomaly score is absorbed as one of the states and the observations are generated by the experts. Our experiments employ a novel evaluation protocol for realistic model performance, demonstrate superior anomaly detection performance than previous methods, and show that our framework has potential in classifying anomaly types using unsupervised learning on a large-scale on-road anomaly dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。