arXiv:2501.07688cs.CV2025-01AAAI被引 9

将深度图修复视为连续形变问题,提升细节恢复与泛化能力

C2PD: Continuity-Constrained Pixelwise Deformation for Guided Depth Super-Resolution

  • 把深度图看作可塑物体,用连续形变模拟修复过程
  • 在四个基准上达到最新最好性能,大尺度任务表现尤佳
  • 适合需要高精度深度重建的应用场景

引导式深度超分辨率(GDSR)在多个领域表现出色,但现有方法常将深度图当作普通图像处理,离散计算明暗值,难以恢复深度图固有的连续性。本文提出新方法,通过将深度图修复问题转化为理想可塑物的连续形变问题,充分利用空间特征与人类对真实物质的抽象感知。设计了连续性约束的非对称像素级操作(CAPO),模拟等体积柔性体在外力作用下的形变;在此基础上构建像素级跨梯度形变(PCGD),可模拟理想塑性物体的形变(无体积约束)。该方法在四个广泛采用的GDSR基准上均取得当前最优结果,尤其在大规模任务中优势显著,具备强泛化能力。

原文摘要 · Abstract (English)

Guided depth super-resolution (GDSR) has demonstrated impressive performance across a wide range of domains, with numerous methods being proposed. However, existing methods often treat depth maps as images, where shading values are computed discretely, making them struggle to effectively restore the continuity inherent in the depth map. In this paper, we propose a novel approach that maximizes the utilization of spatial characteristics in depth, coupled with human abstract perception of real-world substance, by transforming the GDSR issue into deformation of a roughcast with ideal plasticity, which can be deformed by force like a continuous object. Specifically, we firstly designed a cross-modal operation, Continuity-constrained Asymmetrical Pixelwise Operation (CAPO), which can mimic the process of deforming an isovolumetrically flexible object through external forces. Utilizing CAPO as the fundamental component, we develop the Pixelwise Cross Gradient Deformation (PCGD), which is capable of emulating operations on ideal plastic objects (without volume constraint). Notably, our approach demonstrates state-of-the-art performance across four widely adopted benchmarks for GDSR, with significant advantages in large-scale tasks and generalizability.

深度图修复连续形变超分辨率图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。