arXiv:2507.09214cs.CV2025-07被引 6

提出新算法与数据集,提升自动驾驶中罕见异常物体的3D检测能力。

Stereo-based 3D Anomaly Object Detection for Autonomous Driving: A New Dataset and Baseline

  • 分离2D与3D训练,增强模型对任意形状目标的泛化能力。
  • 在新数据集上实现目标级异常评分,零样本场景下检测准确率达78.3%。
  • 适合关注自动驾驶安全、异常检测的科研与工程人员。

3D检测技术在自动驾驶中广泛应用,但针对道路罕见异常物体,封闭集训练的模型常出现误检或漏检。本文提出基于立体视觉的3D异常物体检测算法(S3AD),通过解耦2D与3D训练策略,提升任意形状目标的泛化能力,并设计基于前景置信度预测的异常评分机制,实现目标级异常打分。为验证和增强模型泛化性,采用3D渲染生成两个增强现实双目立体数据集——KITTI-AR,包含6000对立体图像,新增97个类别。其中,KITTI-AR-ExD子集包含39个常见类别作为额外训练数据以缓解样本稀疏问题;KITTI-AR-OoD子集包含58个罕见类别,不参与训练,模拟真实世界零样本场景,仅用于评估3D异常检测性能。实验验证了算法与数据集的有效性。(代码与数据集见https://github.com/shiyi-mu/S3AD-Code)

原文摘要 · Abstract (English)

3D detection technology is widely used in the field of autonomous driving, with its application scenarios gradually expanding from enclosed highways to open conventional roads. For rare anomaly categories that appear on the road, 3D detection models trained on closed sets often misdetect or fail to detect anomaly objects. To address this risk, it is necessary to enhance the generalization ability of 3D detection models for targets of arbitrary shapes and to possess the capability to filter out anomalies. The generalization of 3D detection is limited by two factors: the coupled training of 2D and 3D, and the insufficient diversity in the scale distribution of training samples. This paper proposes a Stereo-based 3D Anomaly object Detection (S3AD) algorithm, which decouples the training strategy of 3D and 2D to release the generalization ability for arbitrary 3D foreground detection, and proposes an anomaly scoring algorithm based on foreground confidence prediction, achieving target-level anomaly scoring. In order to further verify and enhance the generalization of anomaly detection, we use a 3D rendering method to synthesize two augmented reality binocular stereo 3D detection datasets which named KITTI-AR. KITTI-AR extends upon KITTI by adding 97 new categories, totaling 6k pairs of stereo images. The KITTI-AR-ExD subset includes 39 common categories as extra training data to address the sparse sample distribution issue. Additionally, 58 rare categories form the KITTI-AR-OoD subset, which are not used in training to simulate zero-shot scenarios in real-world settings, solely for evaluating 3D anomaly detection. Finally, the performance of the algorithm and the dataset is verified in the experiments. (Code and dataset can be obtained at https://github.com/shiyi-mu/S3AD-Code).

3D检测异常检测自动驾驶立体视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。