提出几何增强的小波扩散模型,提升高光谱图像超分辨率质量
GEWDiff: Geometric Enhanced Wavelet-based Diffusion Model for Hyperspectral Image Super-resolution
- 用小波编码器压缩高光谱图像,保留光谱空间信息
- 引入几何增强扩散过程,4倍超分下保持结构清晰度
- 多级损失函数提升收敛稳定性和重建保真度
高光谱图像(HSI)的超分辨率是重要研究方向。但传统扩散模型难以处理其高维光谱特性,且缺乏对遥感地物拓扑几何结构的理解。多数模型在噪声层级优化损失函数,导致收敛不直观、生成质量欠佳。为此,我们提出几何增强的小波扩散模型(GEWDiff),实现4倍超分辨率重建。该模型采用小波编码器-解码器结构,高效压缩图像至潜在空间并保留光谱-空间信息;通过几何增强扩散过程,有效保持地物几何特征;设计多层级损失函数,促进稳定收敛与更高重建保真度。实验表明,该模型在保真度、光谱精度、视觉真实性和清晰度等维度均达到当前最优水平。
原文摘要 · Abstract (English)
Improving the quality of hyperspectral images (HSIs), such as through super-resolution, is a crucial research area. However, generative modeling for HSIs presents several challenges. Due to their high spectral dimensionality, HSIs are too memory-intensive for direct input into conventional diffusion models. Furthermore, general generative models lack an understanding of the topological and geometric structures of ground objects in remote sensing imagery. In addition, most diffusion models optimize loss functions at the noise level, leading to a non-intuitive convergence behavior and suboptimal generation quality for complex data. To address these challenges, we propose a Geometric Enhanced Wavelet-based Diffusion Model (GEWDiff), a novel framework for reconstructing hyperspectral images at 4-times super-resolution. A wavelet-based encoder-decoder is introduced that efficiently compresses HSIs into a latent space while preserving spectral-spatial information. To avoid distortion during generation, we incorporate a geometry-enhanced diffusion process that preserves the geometric features. Furthermore, a multi-level loss function was designed to guide the diffusion process, promoting stable convergence and improved reconstruction fidelity. Our model demonstrated state-of-the-art results across multiple dimensions, including fidelity, spectral accuracy, visual realism, and clarity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。