提出新方法提升单目3D检测精度,解决深度估计误差问题。
MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors
- 用视角不变的几何误差修正投影公式,改进深度估计。
- 在KITTI上达到当前最优性能,无需额外数据。
- 适合关注单目3D检测与模型优化的研究者。
单目3D目标检测广泛采用透视投影,利用2D边界框和3D物体尺寸引入几何先验以降低深度估计不确定性。然而,由于物体视觉表面引起的深度误差,边界框高度常无法准确反映实际投影中心高度,削弱了几何深度的有效性。直接预测投影高度会丢失2D先验,而多深度预测需复杂分支,未能充分挖掘几何深度优势。本文提出基于Transformer的单目3D检测方法MonoDGP,采用视角不变的几何误差修正投影公式,并系统分析其机制与有效性,作为多深度预测的简洁高效替代方案。同时,将深度引导解码器解耦,构建仅依赖视觉特征的2D解码器,保留2D先验并初始化对象查询,避免3D检测干扰。为进一步优化Transformer解码器输入,引入区域分割头(RSH),生成增强特征与分割嵌入。所提方法在未使用额外数据的情况下,在KITTI基准上实现当前最优性能。代码已开源。
原文摘要 · Abstract (English)
Perspective projection has been extensively utilized in monocular 3D object detection methods. It introduces geometric priors from 2D bounding boxes and 3D object dimensions to reduce the uncertainty of depth estimation. However, due to depth errors originating from the object's visual surface, the height of the bounding box often fails to represent the actual projected central height, which undermines the effectiveness of geometric depth. Direct prediction for the projected height unavoidably results in a loss of 2D priors, while multi-depth prediction with complex branches does not fully leverage geometric depth. This paper presents a Transformer-based monocular 3D object detection method called MonoDGP, which adopts perspective-invariant geometry errors to modify the projection formula. We also try to systematically discuss and explain the mechanisms and efficacy behind geometry errors, which serve as a simple but effective alternative to multi-depth prediction. Additionally, MonoDGP decouples the depth-guided decoder and constructs a 2D decoder only dependent on visual features, providing 2D priors and initializing object queries without the disturbance of 3D detection. To further optimize and fine-tune input tokens of the transformer decoder, we also introduce a Region Segment Head (RSH) that generates enhanced features and segment embeddings. Our monocular method demonstrates state-of-the-art performance on the KITTI benchmark without extra data. Code is available at https://github.com/PuFanqi23/MonoDGP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。