用深度平衡模型统一光谱图像去噪中的空间与光谱特性,提升去噪效果。
Deep Equilibrium Convolutional Sparse Coding for Hyperspectral Image Denoising

- 将稀疏编码转化为固定点问题,实现无限深度网络建模。
- 融合局部、非局部和全局特征,显著提升去噪性能。
- 适合需要高保真度的遥感图像处理任务,尤其对复杂噪声有效。
高光谱图像(HSI)在遥感中至关重要,但常受复杂噪声影响。确保去噪后图像的物理一致性对鲁棒去噪极为关键,催生了基于深度展开的方法。然而,这些方法将物理模型优化映射为预设深度的可学习网络,缺乏收敛性保障。相比之下,深度平衡(DEQ)模型将深层网络的隐藏层视为固定点问题的解,自然对应无限深度网络。在此框架下,我们提出深度平衡卷积稀疏编码(DECSC)框架,统一建模局部空间-光谱相关性、非局部空间自相似性和全局空间一致性,实现鲁棒高光谱图像去噪。在卷积稀疏编码(CSC)框架内,通过共享2D卷积稀疏表示保证跨波段全局空间一致性,非共享3D卷积表示捕捉局部空间-光谱细节。为进一步挖掘非局部自相似性,在2D CSC后嵌入一个Transformer模块。此外,集成细节增强模块以促进图像细节保留。我们将CSC模型的近端梯度下降公式化为固定点问题,并将其迭代更新转换为DEQ框架下的可学习网络结构。实验表明,所提DECSC方法在多种噪声条件下均优于现有最先进方法。
原文摘要 · Abstract (English)
Hyperspectral images (HSIs) play a crucial role in remote sensing but are often degraded by complex noise patterns. Ensuring the physical property of the denoised HSIs is vital for robust HSI denoising, giving the rise of deep unfolding-based methods. However, these methods map the optimization of a physical model to a learnable network with a predefined depth, which lacks convergence guarantees. In contrast, Deep Equilibrium (DEQ) models treat the hidden layers of deep networks as the solution to a fixed-point problem and models them as infinite-depth networks, naturally consistent with the optimization. Under the framework of DEQ, we propose a Deep Equilibrium Convolutional Sparse Coding (DECSC) framework that unifies local spatial-spectral correlations, nonlocal spatial self-similarities, and global spatial consistency for robust HSI denoising. Within the convolutional sparse coding (CSC) framework, we enforce shared 2D convolutional sparse representation to ensure global spatial consistency across bands, while unshared 3D convolutional sparse representation captures local spatial-spectral details. To further exploit nonlocal self-similarities, a transformer block is embedded after the 2D CSC. Additionally, a detail enhancement module is integrated with the 3D CSC to promote image detail preservation. We formulate the proximal gradient descent of the CSC model as a fixed-point problem and transform the iterative updates into a learnable network architecture within the framework of DEQ. Experimental results demonstrate that our DECSC method achieves superior denoising performance compared to state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。