arXiv:2502.20110cs.CV2025-02TPAMI被引 207

UniDepthV2无需额外信息,单图即可跨域精准重建三维深度。

UniDepthV2: Universal Monocular Metric Depth Estimation Made Simpler

论文配图:UniDepthV2: Universal Monocular Metric Depth Estimation Made Simpler
图 1 · 摘自论文原文
  • 直接从单图预测度量3D点,无需额外条件。
  • 在10个数据集零样本测试中表现优于前代模型。
  • 支持边缘增强与置信度输出,适合下游应用。

准确的单目度量深度估计(MMDE)对三维感知与建模任务至关重要。然而,现有方法的高精度仅限于训练域,即使存在轻微域差异也难以泛化,限制了实际应用。本文提出UniDepthV2,一种可跨域从单图重建度量3D场景的新模型。不同于传统范式,UniDepthV2在推理时直接从输入图像预测度量3D点,无需额外信息,追求通用灵活的解决方案。其采用自提示相机模块,生成密集相机表征以引导深度特征;通过伪球面输出表示解耦相机与深度表征;引入几何不变性损失,提升相机提示下深度特征的不变性。相比前代模型,新模型通过边缘引导损失增强深度图边缘定位与锐度,优化架构设计更简洁高效,并新增不确定性输出以支持需置信度的下游任务。在10个深度数据集的零样本评估中,结果一致证明其优越性能与强泛化能力。代码与模型已开源。

原文摘要 · Abstract (English)

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to generalize to unseen domains even in the presence of moderate domain gaps, which hinders their practical applicability. We propose a new model, UniDepthV2, capable of reconstructing metric 3D scenes from solely single images across domains. Departing from the existing MMDE paradigm, UniDepthV2 directly predicts metric 3D points from the input image at inference time without any additional information, striving for a universal and flexible MMDE solution. In particular, UniDepthV2 implements a self-promptable camera module predicting a dense camera representation to condition depth features. Our model exploits a pseudo-spherical output representation, which disentangles the camera and depth representations. In addition, we propose a geometric invariance loss that promotes the invariance of camera-prompted depth features. UniDepthV2 improves its predecessor UniDepth model via a new edge-guided loss which enhances the localization and sharpness of edges in the metric depth outputs, a revisited, simplified and more efficient architectural design, and an additional uncertainty-level output which enables downstream tasks requiring confidence. Thorough evaluations on ten depth datasets in a zero-shot regime consistently demonstrate the superior performance and generalization of UniDepthV2. Code and models are available at https://github.com/lpiccinelli-eth/UniDepth

深度估计单目重建跨域泛化几何不变性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。