用异常检测提升自动驾驶视觉系统安全性
AD4AD: Benchmarking Visual Anomaly Detection Models for Safer Autonomous Driving

- 在合成数据集上对比8种异常检测方法,评估其在不同模型架构下的表现
- 轻量级模型Tiny-Dinomaly实现高精度定位,内存占用仅为全尺寸模型的几分之一
- 适合关注自动驾驶安全、边缘部署与异常感知的研究者和工程师
自动驾驶的视觉系统可靠性高度依赖训练数据分布。当车辆遭遇显著不同的环境(如非常规障碍物)时,其感知能力可能大幅下降。由于自动驾驶失效会直接威胁乘客、行人及其他道路使用者的安全,因此必须防范未知风险。本文探索视觉异常检测(VAD)作为解决方案:VAD可识别训练中未出现的异常物体,并生成像素级异常图,引导驾驶员关注具体区域,无需预设危险形态。我们在AnoVox——目前最大的自动驾驶异常检测合成数据集上,对8种前沿VAD方法进行了基准测试,涵盖从大型网络到轻量级模型(如MobileNet和DeiT-Tiny)的四种主干架构。结果表明,VAD能有效迁移至真实道路场景。其中,Tiny-Dinomaly在精度与效率间取得最佳平衡,实现接近全尺寸模型的定位性能,而内存开销仅为后者的极小部分。本研究推动了更安全、更负责任的自动驾驶部署,切实提升各类道路使用者的保护水平。
原文摘要 · Abstract (English)
The reliability of a machine vision system for autonomous driving depends heavily on its training data distribution. When a vehicle encounters significantly different conditions, such as atypical obstacles, its perceptual capabilities can degrade substantially. Unlike many domains where errors carry limited consequences, failures in autonomous driving translate directly into physical risk for passengers, pedestrians, and other road users. To address this challenge, we explore Visual Anomaly Detection (VAD) as a solution. VAD enables the identification of anomalous objects not present during training, allowing the system to alert the driver when an unfamiliar situation is detected. Crucially, VAD models produce pixel-level anomaly maps that can guide driver attention to specific regions of concern without requiring any prior assumptions about the nature or form of the hazard. We benchmark eight state-of-the-art VAD methods on AnoVox, the largest synthetic dataset for anomaly detection in autonomous driving. In particular, we evaluate performance across four backbone architectures spanning from large networks to lightweight ones such as MobileNet and DeiT-Tiny. Our results demonstrate that VAD transfers effectively to road scenes. Notably, Tiny-Dinomaly achieves the best accuracy-efficiency trade-off for edge deployment, matching full-scale localization performance at a fraction of the memory cost. This study represents a concrete step toward safer, more responsible deployment of autonomous vehicles, ultimately improving protection for passengers, pedestrians, and all road users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。