arXiv:2601.03617cs.CVcs.LG2026-01

对比不同深度模型与语义特征对单目伪LiDAR检测的影响

Systematic Evaluation of Depth Backbones and Semantic Cues for Monocular Pseudo-LiDAR 3D Detection

  • 用相同流程测试NeWCRFs与Depth Anything的深度估计效果
  • NeWCRFs在中等难度上达10.50% AP₃D,优于其他方案
  • 语义特征增益有限,几何精度比语义信息更重要

单目3D目标检测成本低但精度受限于单张图像的度量深度估计。本文在KITTI验证集上系统评估了深度主干网络和特征工程对单目伪LiDAR流水线的影响。在相同伪LiDAR生成与PointRCNN检测协议下,比较了监督度量深度模型NeWCRFs与Depth Anything V2 Metric-Outdoor(Base)。NeWCRFs在灰度强度输入下于中等难度集实现10.50%的AP₃D(IoU=0.7)。进一步测试了基于外观(灰度强度)和语义(实例分割置信度)的点云增强,结果表明语义特征仅带来微弱提升,且基于掩码的采样可能因移除上下文几何而降低性能。最后通过真实2D边界框分析深度精度与距离的关系,发现粗略深度准确度不能充分预测严格的3D IoU。总体而言,在现成LiDAR检测器下,深度主干选择与几何保真度主导性能,远超次级特征注入。

原文摘要 · Abstract (English)

Monocular 3D object detection offers a low-cost alternative to LiDAR, yet remains less accurate due to the difficulty of estimating metric depth from a single image. We systematically evaluate how depth backbones and feature engineering affect a monocular Pseudo-LiDAR pipeline on the KITTI validation split. Specifically, we compare NeWCRFs (supervised metric depth) against Depth Anything V2 Metric-Outdoor (Base) under an identical pseudo-LiDAR generation and PointRCNN detection protocol. NeWCRFs yields stronger downstream 3D detection, achieving 10.50\% AP$_{3D}$ at IoU$=0.7$ on the Moderate split using grayscale intensity (Exp~2). We further test point-cloud augmentations using appearance cues (grayscale intensity) and semantic cues (instance segmentation confidence). Contrary to the expectation that semantics would substantially close the gap, these features provide only marginal gains, and mask-based sampling can degrade performance by removing contextual geometry. Finally, we report a depth-accuracy-versus-distance diagnostic using ground-truth 2D boxes (including Ped/Cyc), highlighting that coarse depth correctness does not fully predict strict 3D IoU. Overall, under an off-the-shelf LiDAR detector, depth-backbone choice and geometric fidelity dominate performance, outweighing secondary feature injection.

单目3D检测伪LiDAR深度估计点云增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。