不依赖深度图的实时单目3D目标检测新方法
AuxDepthNet: Real-Time Monocular 3D Object Detection with Depth-Sensitive Features
- 用隐式深度特征提升空间推理能力,无需外部深度模型
- 在KITTI上达到24.72%(Easy)的3D精度,支持实时推理
- 适合自动驾驶系统中轻量级3D感知场景
单目3D目标检测在自动驾驶系统中极具挑战,因单视角图像缺乏显式深度信息。现有方法常依赖外部深度估计器或昂贵传感器,增加计算开销并影响实时性能。为此,我们提出AuxDepthNet,一种高效实现实时单目3D目标检测的框架,摆脱对外部深度图或预训练深度模型的依赖。该框架引入两个关键组件:辅助深度特征(ADF)模块,隐式学习深度敏感特征以增强空间推理与计算效率;深度位置映射(DPM)模块,将深度位置信息直接嵌入检测流程,实现精准的目标定位与3D边界框回归。基于DepthFusion Transformer架构,辅以深度引导的全局特征融合机制,有效整合视觉与深度敏感特征。在KITTI数据集上的大量实验表明,AuxDepthNet在IoU阈值0.7下取得领先性能:3D AP分别为24.72%(Easy)、18.63%(Moderate)、15.31%(Hard);BEV AP分别为34.11%(Easy)、25.18%(Moderate)、21.90%(Hard)。
原文摘要 · Abstract (English)
Monocular 3D object detection is a challenging task in autonomous systems due to the lack of explicit depth information in single-view images. Existing methods often depend on external depth estimators or expensive sensors, which increase computational complexity and hinder real-time performance. To overcome these limitations, we propose AuxDepthNet, an efficient framework for real-time monocular 3D object detection that eliminates the reliance on external depth maps or pre-trained depth models. AuxDepthNet introduces two key components: the Auxiliary Depth Feature (ADF) module, which implicitly learns depth-sensitive features to improve spatial reasoning and computational efficiency, and the Depth Position Mapping (DPM) module, which embeds depth positional information directly into the detection process to enable accurate object localization and 3D bounding box regression. Leveraging the DepthFusion Transformer architecture, AuxDepthNet globally integrates visual and depth-sensitive features through depth-guided interactions, ensuring robust and efficient detection. Extensive experiments on the KITTI dataset show that AuxDepthNet achieves state-of-the-art performance, with $\text{AP}_{3D}$ scores of 24.72\% (Easy), 18.63\% (Moderate), and 15.31\% (Hard), and $\text{AP}_{\text{BEV}}$ scores of 34.11\% (Easy), 25.18\% (Moderate), and 21.90\% (Hard) at an IoU threshold of 0.7.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。