arXiv:2506.14835cs.CV2025-06被引 1

通过去噪与自蒸馏提升单目3D检测精度,性能超越现有方法。

MonoVQD: Monocular 3D Object Detection with Variational Query Denoising and Self-Distillation

  • 引入可变查询去噪机制,缓解梯度消失问题。
  • 在KITTI上实现新高精度,多视图场景也显著提效。
  • 组件通用性强,适配多种3D检测架构。

从单张图像精确定位3D目标是单目3D检测的核心挑战。尽管DETR类架构提供强大范式,但其直接应用存在固有局限,难以发挥最优性能。本文提出MonoVQD,一种全新框架,旨在从根本上推进基于DETR的单目3D检测。首先,提出掩码分离自注意力机制,将去噪过程融入DETR架构,提升匈牙利匹配稳定性,实现一致优化目标。其次,提出可变查询去噪技术,解决传统去噪方法的梯度消失问题,显式引入随机性以突破效率瓶颈,带来显著性能提升。最后,设计精细的自蒸馏策略,利用后层解码器信息协同优化前层查询质量,增强迭代精炼过程。大量实验表明,MonoVQD在挑战性的KITTI单目基准上达到领先性能。核心组件具备强泛化能力,可无缝集成至其他架构,在nuScenes多视角3D检测任务中亦带来显著增益。

原文摘要 · Abstract (English)

Precisely localizing 3D objects from a single image constitutes a central challenge in monocular 3D detection. While DETR-like architectures offer a powerful paradigm, their direct application in this domain encounters inherent limitations, preventing optimal performance. Our work addresses these challenges by introducing MonoVQD, a novel framework designed to fundamentally advance DETR-based monocular 3D detection. We propose three main contributions. First, we propose the Mask Separated Self-Attention mechanism that enables the integration of the denoising process into a DETR architecture. This improves the stability of Hungarian matching to achieve a consistent optimization objective. Second, we present the Variational Query Denoising technique to address the gradient vanishing problem of conventional denoising methods, which severely restricts the efficiency of the denoising process. This explicitly introduces stochastic properties to mitigate this fundamental limitation and unlock substantial performance gains. Finally, we introduce a sophisticated self-distillation strategy, leveraging insights from later decoder layers to synergistically improve query quality in earlier layers, thereby amplifying the iterative refinement process. Rigorous experimentation demonstrates that MonoVQD achieves superior performance on the challenging KITTI monocular benchmark. Highlighting its broad applicability, MonoVQD's core components seamlessly integrate into other architectures, delivering significant performance gains even in multi-view 3D detection scenarios on the nuScenes dataset and underscoring its robust generalization capabilities.

3D检测单目视觉DETR去噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。