arXiv:2605.30115cs.CV2026-05被引 3

用Transformer从稀疏观测中生成高精度稠密深度图,无需相机参数。

Large Depth Completion Model from Sparse Observations

论文配图:Large Depth Completion Model from Sparse Observations
图 1 · 摘自论文原文
  • 基于现有单目基础模型优化稀疏深度输入,提升初始质量。
  • 引入泊松深度初始化,生成均匀粗略稠密深度图作为结构先验。
  • 用3D坐标回归替代深度图重建,直接学习场景几何结构。

本文提出大型深度补全模型(LDCM),一种简单、高效且鲁棒的单视角度量深度估计框架,适用于稀疏观测。LDCM不依赖复杂架构,仅通过Transformer即可生成度量准确的稠密深度图,在多种数据集和稀疏程度下均优于现有方法。核心思路包括:(1) 利用现有单目基础模型提升稀疏深度输入质量;(2) 重构训练目标以更好捕捉几何结构与度量一致性。具体地,首次提出基于泊松的深度初始化策略,从多样稀疏观测生成均匀的粗略稠密深度图,为网络提供强结构先验。在训练目标上,将传统深度头替换为点图头,直接回归像素级相机空间3D坐标,使模型直接学习底层3D场景结构而非逐像素恢复深度图。该设计免除了对相机内参的需求,自然生成度量尺度的3D点云。大量实验证明,LDCM在多个基准测试中,于不同稀疏水平下持续超越当前最优方法,展现出优异性能与对未见数据分布的强大泛化能力。

原文摘要 · Abstract (English)

This work presents the Large Depth Completion Model (LDCM), a simple, effective, and robust framework for single-view metric depth estimation with sparse observations. Without relying on complex architectural designs, LDCM generates metric-accurate dense depth maps using a transformer. It outperforms existing approaches across diverse datasets and sparse observations. We achieve this from two key perspectives: (1) leveraging existing monocular foundation models to improve the quality of sparse depth inputs, and (2) reformulating training objectives to better capture geometric structure and metric consistency. Specifically, a Poisson-based depth initialization strategy is first introduced to generate a uniform coarse dense depth map from diverse sparse observations, providing a strong structural prior for the network. Regarding the training objective, we replace the conventional depth head with a point map head that regresses per-pixel 3D coordinates in camera space, enabling the model to directly learn the underlying 3D scene structure instead of performing pixel-wise depth map restoration. Moreover, this design eliminates the need for camera intrinsic parameters, allowing LDCM to naturally produce metric-scaled 3D point maps. Extensive experiments demonstrate that LDCM consistently outperforms state-of-the-art methods across multiple benchmarks and varying sparsity levels in both depth completion and point map estimation, showcasing its effectiveness and strong generalization to unseen data distributions.

深度补全3D重建视觉几何Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。