arXiv:2512.17620cs.CV2025-12

用时间立体信息提升多视角3D目标检测精度,兼顾效率。

StereoMV2D: A Sparse Temporal Stereo-Enhanced Framework for Robust Multi-View 3D Object Detection

  • 结合相邻帧的时序立体差异,优化2D检测引导的3D查询初始化
  • 在nuScenes和Argoverse 2上实现更高精度,计算开销低
  • 适合需要高鲁棒性3D检测的自动驾驶系统

多视角3D目标检测是自动驾驶感知的基础任务,如何在检测精度与计算效率间取得平衡至关重要。基于稀疏查询的3D检测器通过可学习查询从多视角图像中高效聚合目标相关特征,实现简洁的端到端检测范式。在此基础上,MV2D利用2D检测结果为查询初始化提供高质量目标先验,从而提升精度与召回率。然而,单帧2D检测固有的深度模糊仍限制了3D查询生成的准确性。为此,我们提出StereoMV2D,一个将时序立体建模融入2D检测引导的多视角3D检测框架。通过利用相邻帧中同一物体的跨时序视差,StereoMV2D增强深度感知并优化查询先验,所有计算均在2D感兴趣区域(RoIs)内高效完成。此外,动态置信度门控机制通过学习帧间匹配矩阵中的统计模式及外观一致性,自适应评估时序立体线索的可靠性,确保在目标外观变化与遮挡下的鲁棒检测。在nuScenes和Argoverse 2数据集上的大量实验表明,StereoMV2D在不显著增加计算开销的前提下实现了更优的检测性能。代码将发布于https://github.com/Uddd821/StereoMV2D。

原文摘要 · Abstract (English)

Multi-view 3D object detection is a fundamental task in autonomous driving perception, where achieving a balance between detection accuracy and computational efficiency remains crucial. Sparse query-based 3D detectors efficiently aggregate object-relevant features from multi-view images through a set of learnable queries, offering a concise and end-to-end detection paradigm. Building on this foundation, MV2D leverages 2D detection results to provide high-quality object priors for query initialization, enabling higher precision and recall. However, the inherent depth ambiguity in single-frame 2D detections still limits the accuracy of 3D query generation. To address this issue, we propose StereoMV2D, a unified framework that integrates temporal stereo modeling into the 2D detection-guided multi-view 3D detector. By exploiting cross-temporal disparities of the same object across adjacent frames, StereoMV2D enhances depth perception and refines the query priors, while performing all computations efficiently within 2D regions of interest (RoIs). Furthermore, a dynamic confidence gating mechanism adaptively evaluates the reliability of temporal stereo cues through learning statistical patterns derived from the inter-frame matching matrix together with appearance consistency, ensuring robust detection under object appearance and occlusion. Extensive experiments on the nuScenes and Argoverse 2 datasets demonstrate that StereoMV2D achieves superior detection performance without incurring significant computational overhead. Code will be available at https://github.com/Uddd821/StereoMV2D.

3D检测多视角时序建模自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。