提出WAVE模型,用小波变换实现从粗到精的深度超分,解决边缘模糊问题。
WAVE: Reversing the Guidance Hierarchy for Coarse-to-Fine Guided Depth Super-Resolution

- 采用多级离散小波变换,反向利用子带和语义令牌,实现粗到精重建
- 在高倍率超分下性能领先,尤其在低分辨率结构缺失时提升显著
- 分离结构与细节重建模块,可解释性强,适合需要清晰边界的场景
引导式深度超分辨率(GDSR)通常通过卷积层次提取RGB引导特征,继承了细粒度到粗粒度的偏差。因此,低层早期出现空间线索,深层则需抑制不对应真实深度边界的特征,易导致伪影和边缘模糊。语义方法同样存在此问题:低层令牌过早使用,全局令牌延迟。我们提出WAVE,引入多级离散小波变换(ML-DWT)作为显式可解释的特征调控机制,通过逆序使用子带和语义令牌,实现从粗到精的重建。同时,将高频与低频内容分别处理,在源头过滤误导性的颜色与纹理信息,避免边缘模糊与伪影,替代网络隐式学习的抑制机制。WAVE将结构与细节重建分离至专用模块:(i) 建模子带、深度特征与语义先验间的交互;(ii) 对高频子带施加语义门控;(iii) 通过可逆耦合机制融合多模态,防止模态坍塌。在多个基准测试中,WAVE性能达到或超越现有方法,高倍率超分下增益最大,此时低分辨率深度图结构最少。
原文摘要 · Abstract (English)
Guided depth super-resolution (GDSR) typically extracts RGB guidance features through convolutional hierarchies, inheriting their fine-to-coarse bias. Thus, low-level spatial cues surface in early layers, leaving the deeper layers to suppress those that do not correspond to true depth boundaries, which risks artifacts and blurred edges. The same fine-to-coarse bias persists in semantics-based methods that consume low-level tokens early and global tokens late. We present WAVE, which introduces a multi-level discrete wavelet transform (ML-DWT) as an explicit and interpretable feature-control mechanism, enabling a coarse-to-fine reconstruction by consuming sub-bands and semantic tokens in reverse of their generation order. WAVE further exploits these sub-bands to treat high- and low-frequency content separately, filtering at its source the misleading RGB color and texture cues that often lead to blurred boundaries and artifacts, offering an intuitive alternative to the suppression learned implicitly by an opaque network. WAVE separates structure and detail reconstruction into dedicated modules that: i) model interactions within and across wavelet sub-bands, depth features, and semantic priors, ii) apply semantic gating to the high-frequency bands, and iii) fuse modalities through an invertible coupling mechanism that prevents collapse onto a single modality. Extensive experiments across multiple benchmarks demonstrate that WAVE matches or outperforms existing methods, with the largest gains at high upsampling factors, where low-resolution depth contains the least structure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。