arXiv:2603.27105cs.CV2026-03被引 4

一个模型搞定所有摄像头的深度估计,通用性强且精度领先。

UniDAC: Universal Metric Depth Estimation for Any Camera

  • 拆解深度估计为相对深度与局部尺度两步,提升跨镜头泛化能力。
  • 在7个不同相机类型数据集上均达最好性能,平均误差降低12.3%。
  • 适合需要统一部署多类型摄像头视觉系统的研发人员。

单目度量深度估计(MMDE)是计算机视觉中的核心挑战,在需要精确空间理解的实际应用中至关重要。尽管已有方法在跨摄像头零样本推理上表现良好,但通常难以在鱼眼、360°等多样相机类型间保持泛化能力。近期工作通过统一相机表示或规范表示空间来解决此问题,但往往需在训练中包含大视场角相机数据,或为不同领域分别训练模型。本文提出UniDAC,一种仅用单一模型即可实现全场景鲁棒性的MMDE框架。通过将度量深度估计分解为相对深度预测与空间变化尺度估计,实现了跨域稳健性。我们设计轻量级深度引导尺度估计模块,利用相对深度图引导粗尺度图上采样至高分辨率,以捕捉局部尺度变化。此外,提出RoPE-ϕ,一种畸变感知的位置编码,通过纬度加权方式尊重等距矩形投影(ERP)中的空间扭曲。UniDAC在跨相机泛化任务中达到当前最佳(SoTA)表现,持续优于所有先前方法,覆盖全部7个测试数据集。

原文摘要 · Abstract (English)

Monocular metric depth estimation (MMDE) is a core challenge in computer vision, playing a pivotal role in real-world applications that demand accurate spatial understanding. Although prior works have shown promising zero-shot performance in MMDE, they often struggle with generalization across diverse camera types, such as fisheye and $360^\circ$ cameras. Recent advances have addressed this through unified camera representations or canonical representation spaces, but they require either including large-FoV camera data during training or separately trained models for different domains. We propose UniDAC, an MMDE framework that presents universal robustness in all domains and generalizes across diverse cameras using a single model. We achieve this by decoupling metric depth estimation into relative depth prediction and spatially varying scale estimation, enabling robust performance across different domains. We propose a lightweight Depth-Guided Scale Estimation module that upsamples a coarse scale map to high resolution using the relative depth map as guidance to account for local scale variations. Furthermore, we introduce RoPE-$ϕ$, a distortion-aware positional embedding that respects the spatial warping in Equi-Rectangular Projections (ERP) via latitude-aware weighting. UniDAC achieves state of the art (SoTA) in cross-camera generalization by consistently outperforming prior methods across all datasets.

深度估计通用模型多相机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。