arXiv:2603.05711cs.CV2026-03中稿 · ECCV被引 3

用单目深度模型一步完成任意稀疏深度补全,提升通用性和速度。

Any to Full: Prompting Depth Anything for Depth Completion in One Stage

  • 将深度补全重构成预训练单目模型的尺度提示适配,一步完成
  • 在平均绝对相对误差上比OMNI-DC提升32.2%,速度比PriorDA快1.4倍
  • 适用于各种稀疏程度和分布的深度数据,适合机器人感知应用

精确的稠密深度估计对机器人感知至关重要,但商用传感器常因硬件限制产生稀疏或不完整的测量。现有基于RGBD融合的深度补全方法依赖训练时的特定RGB分布与深度模式,泛化能力受限。近期工作利用单目深度估计(MDE)模型引入通用几何先验,但两阶段融合策略需显式进行相对-度量对齐,增加计算开销并引入结构畸变。为此,本文提出Any2Full,一种单阶段、领域通用、模式无关的深度补全框架,将补全重构为预训练MDE模型的尺度提示适应。针对不同稀疏度和不规则空间分布,设计了尺度感知提示编码器,从稀疏输入中提炼尺度信息生成统一提示,引导MDE模型输出全局尺度一致的预测,同时保留其几何先验。大量实验表明,Any2Full在鲁棒性与效率上表现优异:平均绝对相对误差(AbsREL)相比OMNI-DC提升32.2%,使用相同MDE主干时速度比PriorDA快1.4倍,确立了通用深度补全新范式。代码与检查点见https://github.com/zhiyuandaily/Any2Full。

原文摘要 · Abstract (English)

Accurate, dense depth estimation is crucial for robotic perception, but commodity sensors often yield sparse or incomplete measurements due to hardware limitations. Existing RGBD-fused depth completion methods learn priors jointly conditioned on training RGB distribution and specific depth patterns, limiting domain generalization and robustness to various depth patterns. Recent efforts leverage monocular depth estimation (MDE) models to introduce domain-general geometric priors, but current two-stage integration strategies relying on explicit relative-to-metric alignment incur additional computation and introduce structured distortions. To this end, we present Any2Full, a one-stage, domain-general, and pattern-agnostic framework that reformulates completion as a scale-prompting adaptation of a pretrained MDE model. To address varying depth sparsity levels and irregular spatial distributions, we design a Scale-Aware Prompt Encoder. It distills scale cues from sparse inputs into unified scale prompts, guiding the MDE model toward globally scale-consistent predictions while preserving its geometric priors. Extensive experiments demonstrate that Any2Full achieves superior robustness and efficiency. It outperforms OMNI-DC by 32.2\% in average AbsREL and delivers a 1.4$\times$ speedup over PriorDA with the same MDE backbone, establishing a new paradigm for universal depth completion. Codes and checkpoints are available at https://github.com/zhiyuandaily/Any2Full.

深度补全单目深度尺度提示机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。