提出新型混合域协同变压器,有效分离高光谱图像的复杂噪声。
Hybrid-Domain Synergistic Transformer for Hyperspectral Image Denoising
- 结合频域增强与多尺度建模,实现空间-频率-通道三域协同处理
- 在真实与合成数据上均显著提升去噪效果,保持高效计算
- 适合高维视觉数据去噪研究者,尤其关注噪声耦合问题
高光谱图像去噪面临空间非均匀噪声与光谱相关干扰的多维耦合挑战。现有深度学习方法多聚焦于RGB图像,难以有效处理高光谱图像(HSI)独特的空谱特性及复杂噪声分布。本文提出一种基于频域增强与多尺度建模的去噪框架——混合域协同变压器网络(HDST),实现空间、频率和通道域的三维协同处理。创新性地引入三个关键机制:(1)采用带多波段卷积的FFT预处理模块,提取跨波段相关性并解耦光谱噪声成分;(2)设计动态跨域注意力模块,通过可学习门控机制自适应融合空间纹理特征与频域噪声先验;(3)构建分层架构,浅层利用多尺度空洞卷积捕获全局噪声统计,深层通过频域后处理实现细节恢复。在真实与合成数据集上的实验表明,HDST显著提升去噪性能的同时保持计算效率,验证了该方法的有效性。本研究为解决HSI及其他高维视觉数据中的复杂噪声耦合问题提供了新思路与通用框架。代码已开源:https://github.com/lhy-cn/HDST-HSIDenoise。
原文摘要 · Abstract (English)
Hyperspectral image denoising faces the challenge of multi-dimensional coupling of spatially non-uniform noise and spectral correlation interference. Existing deep learning methods mostly focus on RGB images and struggle to effectively handle the unique spatial-spectral characteristics and complex noise distributions of hyperspectral images (HSI). This paper proposes an HSI denoising framework, Hybrid-Domain Synergistic Transformer Network (HDST), based on frequency domain enhancement and multiscale modeling, achieving three-dimensional collaborative processing of spatial, frequency and channel domains. The method innovatively integrates three key mechanisms: (1) introducing an FFT preprocessing module with multi-band convolution to extract cross-band correlations and decouple spectral noise components; (2) designing a dynamic cross-domain attention module that adaptively fuses spatial domain texture features and frequency domain noise priors through a learnable gating mechanism; (3) building a hierarchical architecture where shallow layers capture global noise statistics using multiscale atrous convolution, and deep layers achieve detail recovery through frequency domain postprocessing. Experiments on both real and synthetic datasets demonstrate that HDST significantly improves denoising performance while maintaining computational efficiency, validating the effectiveness of the proposed method. This research provides new insights and a universal framework for addressing complex noise coupling issues in HSI and other high-dimensional visual data. The code is available at https://github.com/lhy-cn/HDST-HSIDenoise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。