arXiv:2412.20390cs.CV2024-12被引 2

用深度差异设计新样本识别方式,提升单目深度估计精度

MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning

  • 基于深度差分定义样本类型,实现特征正则化
  • 提出多范围策略区分负样本,优化不同深度区间下的特征学习
  • 在多个数据集和模型上验证有效,适合深度估计研究者

深度度量学习依赖类别标签的一致性或差异性来学习特征,但在单目深度估计中,缺乏自然的类别定义,导致难以应用传统度量学习方法。本文提出MetricDepth,通过基于深度差分的样本识别机制,将样本按与锚点的深度差异划分为不同类型,为单目深度估计模型中的特征正则化提供基础。针对单目深度标注范围广、连续性强的问题,传统统一处理负样本的策略效果有限。为此,我们提出多范围策略,根据深度差分范围对负样本进一步细分,并实施差异化正则化,增强锚点特征与负样本间的区分能力。在多个数据集及模型上的实验表明,MetricDepth在性能提升方面具有显著效果和广泛适用性。

原文摘要 · Abstract (English)

Deep metric learning aims to learn features relying on the consistency or divergence of class labels. However, in monocular depth estimation, the absence of a natural definition of class poses challenges in the leveraging of deep metric learning. Addressing this gap, this paper introduces MetricDepth, a novel method that integrates deep metric learning to enhance the performance of monocular depth estimation. To overcome the inapplicability of the class-based sample identification in previous deep metric learning methods to monocular depth estimation task, we design the differential-based sample identification. This innovative approach identifies feature samples as different sample types by their depth differentials relative to anchor, laying a foundation for feature regularizing in monocular depth estimation models. Building upon this advancement, we then address another critical problem caused by the vast range and the continuity of depth annotations in monocular depth estimation. The extensive and continuous annotations lead to the diverse differentials of negative samples to anchor feature, representing the varied impact of negative samples during feature regularizing. Recognizing the inadequacy of the uniform strategy in previous deep metric learning methods for handling negative samples in monocular depth estimation task, we propose the multi-range strategy. Through further distinction on negative samples according to depth differential ranges and implementation of diverse regularizing, our multi-range strategy facilitates differentiated regularization interactions between anchor feature and its negative samples. Experiments across various datasets and model types demonstrate the effectiveness and versatility of MetricDepth,confirming its potential for performance enhancement in monocular depth estimation task.

深度估计度量学习单目视觉特征正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。