arXiv:2512.16818cs.CV2025-12中稿 · WACV 2026被引 1

用BEV网格单元直接做检测锚点,提升多相机3D目标检测效率与精度。

DenseBEV: Transforming BEV Grid Cells into 3D Objects

  • 将BEV特征网格单元作为检测锚点,实现端到端建模。
  • 在nuScenes上小物体检测mAP提升3.8%,Waymo数据集LET-mAP达60.7%。
  • 适用于需要高精度小目标检测的自动驾驶场景。

当前基于鸟瞰图(BEV)的变压器模型广泛用于多相机3D目标检测。传统方法使用随机查询作为锚点并逐步优化,近期研究则用辅助网络的检测结果替代或补充这些随机查询。本文提出一种更直观高效的方案:直接将BEV特征网格单元用作锚点。该端到端方法利用密集的BEV查询网格,将每个网格单元视为潜在目标。为此,我们设计了一种专为多相机3D目标检测定制的两阶段锚点生成方法。为应对大量查询带来的注意力计算瓶颈,引入基于BEV的非极大值抑制,仅允许未被抑制的目标传播梯度,从而实现高效训练而无需后处理。通过直接使用BEVFormer等编码器的BEV特征作为对象查询,时序信息自然嵌入其中。在此基础上,结合先验检测结果,提出混合时序建模策略,进一步提升检测性能。在nuScenes数据集上的评估显示,即使使用更稀疏的BEV网格(初始锚点更少),本方法在NDS和mAP上仍显著优于基线。尤其对小物体检测效果显著,使行人检测的mAP提升3.8%,在Waymo数据集上LET-mAP提升8%。应用于挑战性更强的Waymo Open数据集,取得60.7%的LET-mAP,超越此前最优结果5.4%。代码已开源。

原文摘要 · Abstract (English)

In current research, Bird's-Eye-View (BEV)-based transformers are increasingly utilized for multi-camera 3D object detection. Traditional models often employ random queries as anchors, optimizing them successively. Recent advancements complement or replace these random queries with detections from auxiliary networks. We propose a more intuitive and efficient approach by using BEV feature cells directly as anchors. This end-to-end approach leverages the dense grid of BEV queries, considering each cell as a potential object for the final detection task. As a result, we introduce a novel two-stage anchor generation method specifically designed for multi-camera 3D object detection. To address the scaling issues of attention with a large number of queries, we apply BEV-based Non-Maximum Suppression, allowing gradients to flow only through non-suppressed objects. This ensures efficient training without the need for post-processing. By using BEV features from encoders such as BEVFormer directly as object queries, temporal BEV information is inherently embedded. Building on the temporal BEV information already embedded in our object queries, we introduce a hybrid temporal modeling approach by integrating prior detections to further enhance detection performance. Evaluating our method on the nuScenes dataset shows consistent and significant improvements in NDS and mAP over the baseline, even with sparser BEV grids and therefore fewer initial anchors. It is particularly effective for small objects, enhancing pedestrian detection with a 3.8% mAP increase on nuScenes and an 8% increase in LET-mAP on Waymo. Applying our method, named DenseBEV, to the challenging Waymo Open dataset yields state-of-the-art performance, achieving a LET-mAP of 60.7%, surpassing the previous best by 5.4%. Code is available at https://github.com/mdaehl/DenseBEV.

3D检测BEV目标检测自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。