arXiv:2512.11926cs.CV2025-12

用Transformer融合补全与检测,提升远距离点云稀疏区域的3D目标检测精度。

TransBridge: Boost 3D Object Detection by Scene-Level Completion with Transformer Decoder

  • 设计TransBridge模块,用Transformer融合检测与补全过程特征。
  • 在nuScenes和Waymo数据集上mAP提升0.7至5.78点,效果稳定。
  • 适合需要高精度3D检测的自动驾驶场景,尤其点云稀疏区域。

3D目标检测对自动驾驶至关重要,能提供移动物体与障碍物的关键信息。在仅有少量激光雷达点的远距离区域进行检测仍具挑战,现有方法多通过点云稠密化缓解稀疏性问题。本文提出一种联合补全与检测框架,在不增加成本的前提下提升稀疏区域的检测特征表现。具体提出TransBridge,一种基于Transformer的上采样模块,融合检测网络与补全网络的特征;检测网络可获得补全网络提供的隐式补全特征。此外,设计动态-静态重建(DSRecon)模块,为补全网络生成稠密激光雷达数据作为真实标签。利用Transformer机制建模通道与空间关系,生成高分辨率特征图用于补全。在nuScenes和Waymo数据集上的大量实验表明,该框架显著提升端到端3D目标检测性能,多个方法下平均精度(mAP)提升0.7至1.5点,展现良好泛化能力;对于两阶段检测框架,mAP最高提升5.78点。

原文摘要 · Abstract (English)

3D object detection is essential in autonomous driving, providing vital information about moving objects and obstacles. Detecting objects in distant regions with only a few LiDAR points is still a challenge, and numerous strategies have been developed to address point cloud sparsity through densification.This paper presents a joint completion and detection framework that improves the detection feature in sparse areas while maintaining costs unchanged. Specifically, we propose TransBridge, a novel transformer-based up-sampling block that fuses the features from the detection and completion networks.The detection network can benefit from acquiring implicit completion features derived from the completion network. Additionally, we design the Dynamic-Static Reconstruction (DSRecon) module to produce dense LiDAR data for the completion network, meeting the requirement for dense point cloud ground truth.Furthermore, we employ the transformer mechanism to establish connections between channels and spatial relations, resulting in a high-resolution feature map used for completion purposes.Extensive experiments on the nuScenes and Waymo datasets demonstrate the effectiveness of the proposed framework.The results show that our framework consistently improves end-to-end 3D object detection, with the mean average precision (mAP) ranging from 0.7 to 1.5 across multiple methods, indicating its generalization ability. For the two-stage detection framework, it also boosts the mAP up to 5.78 points.

3D检测点云补全Transformer自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。