用小波变换分离频域信息,提升多光谱图像超分效果
Wavelet-Assisted Multi-Frequency Attention Network for Pansharpening
- 基于小波变换实现频域无损分离与重建
- 提出频率-查询、空间-键、融合-值的注意力机制
- 在多个数据集上表现优于现有方法,适合真实场景
全色锐化旨在将高分辨率全色(PAN)图像与低分辨率多光谱(LRMS)图像融合,生成高分辨率多光谱(HRMS)图像。尽管频域方法具有明显优势,但多数现有方法仍局限于空域操作,或未能充分挖掘频域潜力。为此,本文提出多频域融合注意力(MFFA),利用小波变换实现频域的清晰分离与无损重构。在此基础上,依据不同特征的物理意义生成频率-查询、空间-键和融合-值,更有效地捕捉频域特异性信息。同时,注重各操作中频率特征的保持。网络采用小波金字塔结构,在多尺度上渐进式融合信息。相比以往频域方法,本方案显著减少频域特征混淆与丢失。在多个数据集上的定量与定性实验表明,该方法优于现有技术,且在真实场景中具备优异泛化能力。
原文摘要 · Abstract (English)
Pansharpening aims to combine a high-resolution panchromatic (PAN) image with a low-resolution multispectral (LRMS) image to produce a high-resolution multispectral (HRMS) image. Although pansharpening in the frequency domain offers clear advantages, most existing methods either continue to operate solely in the spatial domain or fail to fully exploit the benefits of the frequency domain. To address this issue, we innovatively propose Multi-Frequency Fusion Attention (MFFA), which leverages wavelet transforms to cleanly separate frequencies and enable lossless reconstruction across different frequency domains. Then, we generate Frequency-Query, Spatial-Key, and Fusion-Value based on the physical meanings represented by different features, which enables a more effective capture of specific information in the frequency domain. Additionally, we focus on the preservation of frequency features across different operations. On a broader level, our network employs a wavelet pyramid to progressively fuse information across multiple scales. Compared to previous frequency domain approaches, our network better prevents confusion and loss of different frequency features during the fusion process. Quantitative and qualitative experiments on multiple datasets demonstrate that our method outperforms existing approaches and shows significant generalization capabilities for real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。