针对真实场景未知退化,提出自适应深度超分网络。
DORNet: A Degradation Oriented and Regularized Network for Blind Depth Super-Resolution
- 用路由选择实现退化表示的自监督学习。
- 在真实与合成数据上均优于现有方法。
- 适合处理传感器受限下的复杂退化场景。
当前基于RGB引导的深度超分辨率方法在假设退化固定且已知(如双三次下采样)时表现优异,但在真实场景中,由于传感器限制和复杂成像环境(如低反射表面、光照变化),捕获的深度数据常面临非标准且未知的退化,导致现有方法性能显著下降。本文提出一种面向退化的正则化网络(DORNet),通过隐式退化表示自适应应对真实场景中的未知退化。首先设计了一种基于路由选择的自监督退化学习策略,对低分辨率深度数据的退化特征进行建模;为促进有效的RGB-D融合,进一步引入退化导向的特征变换模块,根据学习到的退化先验选择性地将RGB内容传播至深度数据。在真实与合成数据集上的大量实验表明,DORNet在处理未知退化方面具有明显优势,显著优于现有方法。代码已开源:https://github.com/yanzq95/DORNet。
原文摘要 · Abstract (English)
Recent RGB-guided depth super-resolution methods have achieved impressive performance under the assumption of fixed and known degradation (e.g., bicubic downsampling). However, in real-world scenarios, captured depth data often suffer from unconventional and unknown degradation due to sensor limitations and complex imaging environments (e.g., low reflective surfaces, varying illumination). Consequently, the performance of these methods significantly declines when real-world degradation deviate from their assumptions. In this paper, we propose the Degradation Oriented and Regularized Network (DORNet), a novel framework designed to adaptively address unknown degradation in real-world scenes through implicit degradation representations. Our approach begins with the development of a self-supervised degradation learning strategy, which models the degradation representations of low-resolution depth data using routing selection-based degradation regularization. To facilitate effective RGB-D fusion, we further introduce a degradation-oriented feature transformation module that selectively propagates RGB content into the depth data based on the learned degradation priors. Extensive experimental results on both real and synthetic datasets demonstrate the superiority of our DORNet in handling unknown degradation, outperforming existing methods. The code is available at https://github.com/yanzq95/DORNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。