arXiv:2503.22351cs.CV2025-03ICCV被引 2

提出PRO框架,让模型一次看图就精准估计高分辨率深度图。

One Look is Enough: Seamless Patchwise Refinement for Zero-Shot Monocular Depth Estimation on High-Resolution Images

  • 分块处理时用重叠区域一致性约束,避免拼接错位。
  • 在多个真实数据集上显著提升高分辨率深度估计精度。
  • 适合需要快速、准确估计真实场景深度的工业应用。

零样本深度估计模型虽具强泛化能力,但面对高分辨率图像时表现不佳:全图处理导致内存爆炸且精度下降,下采样则引发深度图边缘模糊。现有分块方法在拼接时易产生深度不连续问题,且依赖合成数据训练,泛化性差。为此,本文提出Patch Refine Once(PRO)框架,包含两个核心组件:(i) 分组分块一致性训练,在单次反向传播中联合处理四个重叠分块,并对重叠区域施加一致性损失,提升测试效率并缓解拼接伪影;(ii) 无偏掩码机制,防止模型过度拟合数据集特有偏差,增强对真实世界数据的泛化能力。在Booster、ETH3D、Middlebury 2014和NuScenes等数据集上的零样本评估表明,PRO可无缝集成至现有深度估计模型,显著改善高分辨率图像下的深度估计效果。

原文摘要 · Abstract (English)

Zero-shot depth estimation (DE) models exhibit strong generalization performance as they are trained on large-scale datasets. However, existing models struggle with high-resolution images due to the discrepancy in image resolutions of training (with smaller resolutions) and inference (for high resolutions). Processing them at full resolution leads to decreased estimation accuracy on depth with tremendous memory consumption, while downsampling to the training resolution results in blurred edges in the estimated depth images. Prevailing high-resolution depth estimation methods adopt a patch-based approach, which introduces depth discontinuity issues when reassembling the estimated depth patches, resulting in test-time inefficiency. Additionally, to obtain fine-grained depth details, these methods rely on synthetic datasets due to the real-world sparse ground truth depth, leading to poor generalizability. To tackle these limitations, we propose Patch Refine Once (PRO), an efficient and generalizable tile-based framework. Our PRO consists of two key components: (i) Grouped Patch Consistency Training that enhances test-time efficiency while mitigating the depth discontinuity problem by jointly processing four overlapping patches and enforcing a consistency loss on their overlapping regions within a single backpropagation step, and (ii) Bias Free Masking that prevents the DE models from overfitting to dataset-specific biases, enabling better generalization to real-world datasets even after training on synthetic data. Zero-shot evaluations on Booster, ETH3D, Middlebury 2014, and NuScenes demonstrate that our PRO can be seamlessly integrated into existing depth estimation models.

深度估计高分辨率分块推理泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。