解决车联网中车辆与路侧单元感知差异和定位误差问题,提升3D目标检测鲁棒性。
V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection
- 通过知识蒸馏与特征补偿,学习跨节点一致的表征以缩小域差距。
- 在DAIR-V2X数据集上达到领先性能,显著提升复杂场景下的检测准确率。
- 适合车联网协同感知、自动驾驶系统研发人员参考使用。
在车联网协同感知中,异构节点间的域差距对有效信息融合构成重大挑战。由于延迟和GPS定位噪声带来的位姿误差,进一步加剧了特征错位问题。为此,本文提出V2X-DGPE,一种高精度且鲁棒的车-路协同感知框架。该框架采用知识蒸馏机制与特征补偿模块,从多源数据中学习域不变表征,有效缓解车辆与路侧单元之间的特征分布差异。利用历史信息增强对当前场景的全面理解。此外,协同融合模块引入异构自注意力机制,提取并融合车辆与基础设施的异构表征。为应对位姿误差,V2X-DGPE设计可变形注意力机制,通过动态偏移采样点,自适应聚焦输入特征的关键区域。在真实世界数据集DAIR-V2X上的大量实验表明,所提方法优于现有方法,达到最先进的检测性能。代码已开源:https://github.com/wangsch10/V2X-DGPE。
原文摘要 · Abstract (English)
In V2X collaborative perception, the domain gaps between heterogeneous nodes pose a significant challenge for effective information fusion. Pose errors arising from latency and GPS localization noise further exacerbate the issue by leading to feature misalignment. To overcome these challenges, we propose V2X-DGPE, a high-accuracy and robust V2X feature-level collaborative perception framework. V2X-DGPE employs a Knowledge Distillation Framework and a Feature Compensation Module to learn domain-invariant representations from multi-source data, effectively reducing the feature distribution gap between vehicles and roadside infrastructure. Historical information is utilized to provide the model with a more comprehensive understanding of the current scene. Furthermore, a Collaborative Fusion Module leverages a heterogeneous self-attention mechanism to extract and integrate heterogeneous representations from vehicles and infrastructure. To address pose errors, V2X-DGPE introduces a deformable attention mechanism, enabling the model to adaptively focus on critical parts of the input features by dynamically offsetting sampling points. Extensive experiments on the real-world DAIR-V2X dataset demonstrate that the proposed method outperforms existing approaches, achieving state-of-the-art detection performance. The code is available at https://github.com/wangsch10/V2X-DGPE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。