无需激光雷达,实现实时高精度单目3D检测。
LeAD-M3D: Leveraging Asymmetric Distillation for Real-Time Monocular 3D Detection
- 用不对称知识蒸馏提升深度推理能力
- 在KITTI、Waymo等数据集达顶尖准确率
- 速度比同类模型快3.6倍,适合实时系统
单目3D目标检测因深度模糊、视角变化和3D推理计算开销大而面临挑战。现有方法或依赖激光雷达或几何先验弥补深度缺失,或牺牲效率换取精度。本文提出LeAD-M3D,无需额外模态即可实现最先进精度与实时推理。核心包括:1)不对称增强去噪蒸馏(A2D2),通过质量与重要性加权的深度特征损失,将清晰图像教师的几何知识迁移到受混合噪声干扰的学生模型;2)3D感知一致匹配(CM₃D),融合3D MGIoU改进预测与真实框的匹配得分,提升监督稳定性与精度;3)置信度门控3D推理(CGI₃D),仅在高置信区域执行昂贵3D回归,加速推理。三者协同使LeAD-M3D在KITTI、Waymo上达到当前最优性能,在Rope3D上取得最高车辆AP,且相比高精度模型(如MonoDiff)最快提速3.6倍。结果表明,无需激光雷达、双目或多视图,也可实现高保真与实时单目3D检测。
原文摘要 · Abstract (English)
Real-time monocular 3D object detection remains challenging due to severe depth ambiguity, viewpoint shifts, and the high computational cost of 3D reasoning. Existing approaches either rely on LiDAR or geometric priors to compensate for missing depth or sacrifice efficiency to achieve competitive accuracy. We introduce LeAD-M3D, a monocular 3D detector that achieves state-of-the-art accuracy and real-time inference without extra modalities. Our method is enabled by three key components. Asymmetric Augmentation Denoising Distillation (A2D2) transfers geometric knowledge from a clean-image teacher to a MixUp-noised student via a quality- and importance-weighted depth-feature loss, enabling stronger depth reasoning without LiDAR. 3D-aware Consistent Matching (CM$_{\text{3D}}$) improves prediction-to-ground truth assignment by integrating 3D MGIoU into the matching score, yielding stable and precise supervision. Finally, Confidence-Gated 3D Inference (CGI$_{\text{3D}}$) accelerates inference by restricting expensive 3D regression to confident regions. Together, these contributions set a new Pareto frontier for monocular 3D detection: LeAD-M3D achieves state-of-the-art accuracy on KITTI and Waymo, and the best reported car AP on Rope3D, while running up to 3.6$\,\times$ faster than prior high-accuracy models (e.g., MonoDiff). LeAD-M3D demonstrates that high fidelity and real-time monocular 3D detection is simultaneously attainable, without LiDAR, stereo, or strong geometric assumptions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。