构建首个可控多传感器遮挡数据集,助力自动驾驶感知鲁棒性评估
Occluded nuScenes: A Multi-Sensor Dataset for Evaluating Perception Robustness in Automated Driving
- 基于nuScenes扩展,为相机、雷达、激光雷达设计可控遮挡
- 相机有4类遮挡(2种公开+2种新设计),雷达和激光雷达各有3类退化
- 支持感知模型在部分传感器失效下的可复现评测,适合安全关键研究
自动驾驶的鲁棒感知需在恶劣条件下保持可靠性能,但现有数据集极少提供跨多模态、可控且可复现的传感器退化。为此,我们推出Occluded nuScenes数据集,作为广泛使用的nuScenes基准的扩展。相机模态提供完整版与精简版,包含四类遮挡:两类源自公开实现,另两类为新设计;雷达与激光雷达则提供参数化遮挡脚本,各实现三种退化类型,支持灵活、重复生成遮挡数据。该资源可支撑感知模型在部分传感器失效与环境干扰下的统一、可复现评估。作为首个具备可控、可复现多传感器遮挡的基准,本数据集旨在推动鲁棒传感器融合、韧性分析及安全关键感知的研究。
原文摘要 · Abstract (English)
Robust perception in automated driving requires reliable performance under adverse conditions, where sensors may be affected by partial failures or environmental occlusions. Although existing autonomous driving datasets inherently contain sensor noise and environmental variability, very few enable controlled, parameterised, and reproducible degradations across multiple sensing modalities. This gap limits the ability to systematically evaluate how perception and fusion architectures perform under well-defined adverse conditions. To address this limitation, we introduce the Occluded nuScenes Dataset, a novel extension of the widely used nuScenes benchmark. For the camera modality, we release both the full and mini versions with four types of occlusions, two adapted from public implementations and two newly designed. For radar and LiDAR, we provide parameterised occlusion scripts that implement three types of degradations each, enabling flexible and repeatable generation of occluded data. This resource supports consistent, reproducible evaluation of perception models under partial sensor failures and environmental interference. By releasing the first multi-sensor occlusion dataset with controlled and reproducible degradations, we aim to advance research on robust sensor fusion, resilience analysis, and safety-critical perception in automated driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。