arXiv:2409.01816cs.CV2024-09AAAI被引 29

提升3D目标检测的鸟瞰图几何精度,实现更精细的场景还原。

GeoBEV: Learning Geometric BEV Representation for Multi-view 3D Object Detection

  • 提出径向-笛卡尔采样方法,高效生成高分辨率密集鸟瞰图特征。
  • 设计内框标签与中心感知损失,精准捕捉物体内部几何结构。
  • 在nuScenes数据集上达到66.2% NDS,适合自动驾驶感知系统优化。

鸟瞰图(BEV)表示已成为多视角3D目标检测的主流范式,展现出出色的感知能力。然而,现有方法忽视了BEV表示的几何质量,导致其处于低分辨率状态,无法恢复场景的真实几何信息。本文识别出先前方法限制BEV几何质量的缺陷,提出径向-笛卡尔贝叶图采样(RC-Sampling),可高效生成高分辨率稠密的BEV表示,以恢复细粒度几何信息。此外,设计了一种新型内框标签(In-Box Label),替代传统由激光雷达点生成的深度标签,该标签反映物体的实际几何结构而非仅表面,将真实世界几何信息注入到BEV表示中。结合内框标签,提出中心感知内损失(CAI Loss),用于捕捉物体内部几何结构。最后,将上述模块集成至新型多视角3D目标检测器GeoBEV中,在nuScenes测试集上取得66.2% NDS的最先进性能。代码已开源。

原文摘要 · Abstract (English)

Bird's-Eye-View (BEV) representation has emerged as a mainstream paradigm for multi-view 3D object detection, demonstrating impressive perceptual capabilities. However, existing methods overlook the geometric quality of BEV representation, leaving it in a low-resolution state and failing to restore the authentic geometric information of the scene. In this paper, we identify the drawbacks of previous approaches that limit the geometric quality of BEV representation and propose Radial-Cartesian BEV Sampling (RC-Sampling), which outperforms other feature transformation methods in efficiently generating high-resolution dense BEV representation to restore fine-grained geometric information. Additionally, we design a novel In-Box Label to substitute the traditional depth label generated from the LiDAR points. This label reflects the actual geometric structure of objects rather than just their surfaces, injecting real-world geometric information into the BEV representation. In conjunction with the In-Box Label, Centroid-Aware Inner Loss (CAI Loss) is developed to capture the inner geometric structure of objects. Finally, we integrate the aforementioned modules into a novel multi-view 3D object detector, dubbed GeoBEV, which achieves a state-of-the-art result of 66.2\% NDS on the nuScenes test set. The code is available at https://github.com/mengtan00/GeoBEV.git.

3D检测鸟瞰图几何建模自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。