arXiv:2511.01175cs.CV2025-11ICCV被引 3

用扩散模型与小波谱结合,提升单图超分的细节真实感。

Diffusion Transformer meets Multi-level Wavelet Spectrum for Single Image Super-Resolution

  • 基于多层级小波变换分解图像频谱,构建频域-空间联合表示
  • 设计双解码器处理高低频子带差异,避免生成失真
  • 在多个数据集上表现优异,兼顾视觉质量与重建保真度

离散小波变换(DWT)已被广泛用于提升图像超分辨率(SR)性能。尽管部分基于DWT的方法通过捕捉细粒度频率信号提升了效果,但大多数方法忽略了多尺度频率子带之间的相互关系,导致重建图像出现不一致和不自然的伪影。为此,我们提出一种基于图像小波谱的扩散变压器模型(DTWSR)。DTWSR结合了扩散模型与变压器的优势,有效捕捉多尺度频率子带间的关联,实现更一致、更真实的超分图像。具体而言,采用多层级离散小波变换将图像分解为小波谱;提出金字塔式标记化方法,将谱特征嵌入序列令牌,便于模型同时学习空间与频率域特征;精心设计双解码器以分别处理低频与高频子带的差异,同时保持其在图像生成中的对齐。在多个基准数据集上的大量实验表明,该方法在感知质量和保真度方面均表现出色。

原文摘要 · Abstract (English)

Discrete Wavelet Transform (DWT) has been widely explored to enhance the performance of image superresolution (SR). Despite some DWT-based methods improving SR by capturing fine-grained frequency signals, most existing approaches neglect the interrelations among multiscale frequency sub-bands, resulting in inconsistencies and unnatural artifacts in the reconstructed images. To address this challenge, we propose a Diffusion Transformer model based on image Wavelet spectra for SR (DTWSR). DTWSR incorporates the superiority of diffusion models and transformers to capture the interrelations among multiscale frequency sub-bands, leading to a more consistence and realistic SR image. Specifically, we use a Multi-level Discrete Wavelet Transform to decompose images into wavelet spectra. A pyramid tokenization method is proposed which embeds the spectra into a sequence of tokens for transformer model, facilitating to capture features from both spatial and frequency domain. A dual-decoder is designed elaborately to handle the distinct variances in low-frequency and high-frequency sub-bands, without omitting their alignment in image generation. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of our method, with high performance on both perception quality and fidelity.

超分辨率扩散模型小波变换频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。