arXiv:2605.00595cs.CVcs.RO2026-05中稿 · IEEE VTC 2026-Spri…

让自动驾驶车通过车联网共享目标信息,提升3D物体检测的鲁棒性。

Robust Fusion of Object-Level V2X for Learned 3D Object Detection

论文配图:Robust Fusion of Object-Level V2X for Learned 3D Object Detection
图 1 · 摘自论文原文
  • 用车联网发送的目标级信息转换为鸟瞰图输入,融合进检测模型。
  • 理想条件下检测精度NDS达0.80,但依赖车联网时易失效。
  • 引入噪声训练和置信度编码,显著提升真实场景下的稳定性。

自动驾驶感知主要依赖车载传感器(如摄像头、雷达),但受限于视线和视角,遮挡或恶劣天气下易失效。与此同时,车联网(V2X)通信正逐步普及,可实现车辆与基础设施间的目标级状态共享,弥补车载感知不足。本文研究如何将此类协作信息融入3D物体检测,并评估其在真实世界缺陷(如延迟、定位误差、低渗透率)下的鲁棒性。基于nuScenes数据集,我们模拟了带控制噪声和目标丢失的协作消息,将其转换为专用鸟瞰图输入,并融合至BEVFusion类检测器中。结果表明,在理想条件下,协作信息可将检测性能提升至NDS 0.80;然而,仅在理想数据上训练的模型对V2X失效极为敏感。本文提出的噪声感知训练策略结合显式置信度编码,显著增强系统鲁棒性,在严重噪声和低渗透率下仍保持性能优势。

原文摘要 · Abstract (English)

Perception for automated driving is largely based on onboard environmental sensors, such as cameras and radar, which are cost-effective but limited by line-of-sight and field-of-view constraints. These inherent limitations may cause onboard perception to fail under occlusions or poor visibility conditions. In parallel, cooperative awareness via vehicle-to-everything (V2X) communication is becoming increasingly available, enabling vehicles and infrastructure to share their own state as object-level information that complements onboard perception. In this work, we study how such V2X information can be integrated into 3D object detection and how robust the resulting system is to realistic V2X imperfections. Using the nuScenes dataset, we emulate object-level cooperative awareness messages from ground truth, injecting controlled noise and object dropout to mimic real-world conditions such as latency, localization errors, and low V2X penetration rates. We convert these messages into a dedicated bird's-eye view (BEV) input and fuse them into a BEVFusion-style detector. Our results demonstrate that while object-level cooperative information can substantially improve detection performance, achieving an NDS of 0.80 under favorable conditions, models trained on idealized data become fragile and over-reliant on V2X. Conversely, our proposed noise-aware training strategy, coupled with explicit confidence encoding, enhances robustness, maintaining performance gains even under severe noise and reduced V2X penetration.

3D检测车联网鲁棒性BEV

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。