arXiv:2503.10777cs.CV2025-03被引 5

用Transformer学习体素高度,提升路边视觉3D检测精度

HeightFormer: Learning Height Prediction in Voxel Features for Roadside Vision Centric 3D Object Detection via Transformer

  • 将体素特征分组为局部高度序列,用注意力机制预测高度分布
  • 在DAIR-V2X-I和Rope3D上达到领先性能,显著优于现有方法
  • 适合做高精度路边3D感知的自动驾驶研究者参考

路边视觉中心的3D目标检测近年来受到广泛关注,可扩展自动驾驶感知范围并提升道路安全。以往方法侧重于预测像素级高度而非深度,虽在路边视觉感知上取得进展,但受限于图像特征的近大远小透视特性,难以准确理解物体在三维世界中的真实尺寸。相比图像特征,鸟瞰图(BEV)特征和体素特征能更真实地反映物体在三维空间的分布,但BEV特征因缺乏显式高度信息而丢失细节,体素特征则计算成本高昂。为此,本文提出一种基于Transformer的高效框架HeightFormer,通过将体素特征划分为局部高度序列,并利用注意力机制预测高度分布,再重新组装生成精确的3D特征。该方法在两个大规模路边基准数据集DAIR-V2X-I和Rope3D上进行了充分实验,结果表明其在路边视觉中心3D目标检测任务中超越当前最先进方法。

原文摘要 · Abstract (English)

Roadside vision centric 3D object detection has received increasing attention in recent years. It expands the perception range of autonomous vehicles, enhances the road safety. Previous methods focused on predicting per-pixel height rather than depth, making significant gains in roadside visual perception. While it is limited by the perspective property of near-large and far-small on image features, making it difficult for network to understand real dimension of objects in the 3D world. BEV features and voxel features present the real distribution of objects in 3D world compared to the image features. However, BEV features tend to lose details due to the lack of explicit height information, and voxel features are computationally expensive. Inspired by this insight, an efficient framework learning height prediction in voxel features via transformer is proposed, dubbed HeightFormer. It groups the voxel features into local height sequences, and utilize attention mechanism to obtain height distribution prediction. Subsequently, the local height sequences are reassembled to generate accurate 3D features. The proposed method is applied to two large-scale roadside benchmarks, DAIR-V2X-I and Rope3D. Extensive experiments are performed and the HeightFormer outperforms the state-of-the-art methods in roadside vision centric 3D object detection task.

3D检测视觉感知Transformer体素特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。