用小波分解增强高频纹理,实现任意尺度图像超分辨率
Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution
- 通过小波变换分解特征为四个频带,提取高频先验信息
- 在多个基准数据集上超越现有最优方法,细节恢复更清晰
- 适合需要精细纹理重建的图像超分任务
隐式神经表示在任意尺度图像超分辨率中展现出巨大潜力。现有方法通常基于查询坐标和邻近特征预测像素,忽视了图像中高频先验信息的重要性,导致高频纹理细节恢复能力有限。为此,本文提出局部隐式小波变换器(LIWT),以提升高频纹理重建效果。具体而言,利用离散小波变换(DWT)将编码器提取的特征分解为包含不同频率信息的四个子带。引入小波增强残差模块(WERM)将这四个子带转换为高频先验,并结合小波互投影融合(WMPF)与小波感知隐式注意力(WIA),充分挖掘高频先验信息以恢复图像中的高频细节。在多个基准数据集上的大量实验表明,无论定性还是定量结果,LIWT在任意尺度超分任务中均表现优异,优于当前主流方法。代码已开源:https://github.com/dmhdmhdmh/LIWT。
原文摘要 · Abstract (English)
Implicit neural representations have recently demonstrated promising potential in arbitrary-scale Super-Resolution (SR) of images. Most existing methods predict the pixel in the SR image based on the queried coordinate and ensemble nearby features, overlooking the importance of incorporating high-frequency prior information in images, which results in limited performance in reconstructing high-frequency texture details in images. To address this issue, we propose the Local Implicit Wavelet Transformer (LIWT) to enhance the restoration of high-frequency texture details. Specifically, we decompose the features extracted by an encoder into four sub-bands containing different frequency information using Discrete Wavelet Transform (DWT). We then introduce the Wavelet Enhanced Residual Module (WERM) to transform these four sub-bands into high-frequency priors, followed by utilizing the Wavelet Mutual Projected Fusion (WMPF) and the Wavelet-aware Implicit Attention (WIA) to fully exploit the high-frequency prior information for recovering high-frequency details in images. We conducted extensive experiments on benchmark datasets to validate the effectiveness of LIWT. Both qualitative and quantitative results demonstrate that LIWT achieves promising performance in arbitrary-scale SR tasks, outperforming other state-of-the-art methods. The code is available at https://github.com/dmhdmhdmh/LIWT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。