通过分箱建模深度退化,提升超分辨率精度与鲁棒性。
DegBins: Degradation-Driven Binning for Depth Super-Resolution

- 将深度超分辨率转为分类-回归混合问题,用离散分箱加权表示残差。
- 根据局部退化特征动态调整分箱范围和概率分布,提升建模灵活性。
- 多阶段细化设计,尤其在严重退化区域表现更优,适合高精度场景应用。
深度超分辨率(DSR)旨在从低分辨率(LR)深度图恢复高分辨率(HR)深度图。传统方法通常利用彩色图像引导,在低维特征空间中学习HR与LR之间的残差,但这种加法形式难以准确捕捉复杂的空间变化退化关系。本文提出DegBins,一种基于退化驱动分箱的新型DSR框架,将基于回归的DSR重构为混合分类-回归问题:残差深度由离散深度分箱的线性组合表示,并赋予其学习得到的概率分布,从而获得更灵活、更具表达力的建模能力。此外,DegBins在高维特征空间中建模HR与LR间的退化关系,实现基于局部退化特性的自适应分箱范围调整与概率优化。为逐步提升重建质量,该框架采用多阶段细化策略,每阶段基于前序估计进行更细粒度的分箱划分与概率更新。这种由粗到精的设计显著提升了在严重退化或结构复杂区域的深度恢复精度。在五个基准数据集上的大量实验表明,DegBins在准确性、鲁棒性和泛化能力上均持续优于现有最先进方法。
原文摘要 · Abstract (English)
Depth super-resolution (DSR) aims to recover a high-resolution (HR) depth map from its low-resolution (LR) counterpart. With color image guidance, this task is typically formulated as learning the residual between HR and LR in a low-dimensional feature space. However, this additive formulation is insufficient to accurately capture the complex relationship between HR and LR, especially under spatially varying degradations. In this paper, we introduce DegBins, a novel DSR framework that leverages degradation-driven binning to adaptively enhance residual modeling. Specifically, DegBins reformulates the regression-based DSR as a hybrid classification-regression problem, where the residual depth is represented as a linear combination of discrete depth bins weighted by their learned probability distribution, yielding more flexible and expressive representations. Furthermore, DegBins models the degradation relationship between HR and LR in a high-dimensional feature space, enabling adaptive bin range adjustment and probability optimization conditioned on local degradation characteristics. To progressively improve reconstruction quality, DegBins adopts a multi-stage refinement scheme, where each stage performs finer-grained bin partitioning and probability updating based on the former estimation. This coarse-to-fine design facilitates more accurate depth recovery, particularly in regions with severe degradations or complex structural variations. Extensive experiments across five benchmarks demonstrate that DegBins consistently outperforms existing state-of-the-art methods in terms of accuracy, robustness, and generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。