通过联合去噪与检测,提升恶劣天气下车联网感知效率。
DenoiseCP-Net: Efficient Collective Perception in Adverse Weather via Joint LiDAR-Based 3D Object Detection and Denoising
- 将点云去噪与3D目标检测融合于统一网络,减少冗余计算。
- 在雨雪雾条件下,通信带宽降低23.6%,检测精度不变。
- 适合自动驾驶中需低延迟、高鲁棒性的协同感知场景。
尽管自动驾驶有望显著降低交通事故,但其感知系统仍易受恶劣天气和环境遮挡导致的传感器退化影响。集体感知通过车辆间信息共享,可有效缓解此类问题,但现有研究极少关注恶劣天气下的集体感知。为此,本文首次系统研究了基于激光雷达的恶劣天气集体感知,并提出一种新型多任务架构——DenoiseCP-Net。该模型在稀疏卷积主干网络中集成体素级噪声过滤与目标检测,避免传统两阶段流程中的重复计算。此设计不仅降低推理延迟与计算开销,还通过剔除无意义噪声,显著减少通信负载。我们基于知名OPV2V数据集,使用真实感天气模拟模型添加雨、雪、雾等条件,实验表明:DenoiseCP-Net在恶劣天气下实现近乎完美的去噪效果,通信带宽最高下降23.6%,同时保持原有检测精度,且合作车辆推理延迟显著降低。
原文摘要 · Abstract (English)
While automated vehicles hold the potential to significantly reduce traffic accidents, their perception systems remain vulnerable to sensor degradation caused by adverse weather and environmental occlusions. Collective perception, which enables vehicles to share information, offers a promising approach to overcoming these limitations. However, to this date collective perception in adverse weather is mostly unstudied. Therefore, we conduct the first study of LiDAR-based collective perception under diverse weather conditions and present a novel multi-task architecture for LiDAR-based collective perception under adverse weather. Adverse weather conditions can not only degrade perception capabilities, but also negatively affect bandwidth requirements and latency due to the introduced noise that is also transmitted and processed. Denoising prior to communication can effectively mitigate these issues. Therefore, we propose DenoiseCP-Net, a novel multi-task architecture for LiDAR-based collective perception under adverse weather conditions. DenoiseCP-Net integrates voxel-level noise filtering and object detection into a unified sparse convolution backbone, eliminating redundant computations associated with two-stage pipelines. This design not only reduces inference latency and computational cost but also minimizes communication overhead by removing non-informative noise. We extended the well-known OPV2V dataset by simulating rain, snow, and fog using our realistic weather simulation models. We demonstrate that DenoiseCP-Net achieves near-perfect denoising accuracy in adverse weather, reduces the bandwidth requirements by up to 23.6% while maintaining the same detection accuracy and reducing the inference latency for cooperative vehicles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。