无需训练,用稀疏测量将相对深度转为真实尺度。
Region-aware Depth Scale Adaptation with Sparse Measurements
- 不依赖学习,利用稀疏深度数据校准模型输出
- 实现真值尺度深度,且保持原模型泛化能力
- 适合需快速部署的实景应用,如机器人导航
近年来,深度预测领域的基础模型在零样本单目深度估计方面取得显著进展,生成的深度图效果出色,但通常为相对尺度而非度量尺度。这一局限性制约了其在真实场景中的直接应用。已有方法通过再训练或微调实现尺度适配,但代价高昂且常损害模型原本的泛化性能。本文提出一种非学习方法,仅依赖稀疏深度测量,即可将基础模型的相对尺度输出转换为度量尺度深度。该方法无需重新训练或微调,有效保留原始模型的强大泛化能力,同时生成真实尺度深度。实验验证了其有效性,表明该方法可在不增加计算成本且不牺牲泛化能力的前提下,弥合相对深度与度量深度之间的差距。
原文摘要 · Abstract (English)
In recent years, the emergence of foundation models for depth prediction has led to remarkable progress, particularly in zero-shot monocular depth estimation. These models generate impressive depth predictions; however, their outputs are often in relative scale rather than metric scale. This limitation poses challenges for direct deployment in real-world applications. To address this, several scale adaptation methods have been proposed to enable foundation models to produce metric depth. However, these methods are typically costly, as they require additional training on new domains and datasets. Moreover, fine-tuning these models often compromises their original generalization capabilities, limiting their adaptability across diverse scenes. In this paper, we introduce a non-learning-based approach that leverages sparse depth measurements to adapt the relative-scale predictions of foundation models into metric-scale depth. Our method requires neither retraining nor fine-tuning, thereby preserving the strong generalization ability of the original foundation models while enabling them to produce metric depth. Experimental results demonstrate the effectiveness of our approach, high-lighting its potential to bridge the gap between relative and metric depth without incurring additional computational costs or sacrificing generalization ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。