利用近红外与可见光图像的频域互补性,提升复杂噪声下图像去噪效果。
Complementary Advantages: Exploiting Cross-Field Frequency Correlation for NIR-Assisted Image Denoising
- 基于频域统计分析,发现近红外与可见光图像在频率上的互补相关性。
- 提出动态选择与全量融合双机制,有效平衡两域信息贡献。
- 在模拟与真实数据上均超越现有方法,适合多模态图像处理研究者。
现有单图去噪算法在处理复杂噪声图像时难以恢复细节。引入近红外(NIR)图像为可见光图像去噪提供了新思路。然而,由于NIR与RGB图像间存在不一致性,现有方法在图像融合过程中仍难以平衡两域贡献。为此,本文提出跨领域频域相关性网络(FCENet)。首先通过深度频域统计分析,建立基于NIR-RGB图像对的频域相关性先验,揭示两域在频域中的互补特性。在此基础上,构建包含频率动态选择机制(FDSM)与频率全量融合机制(FEFM)的频域学习框架:FDSM在频域动态选择互补信息,FEFM强化共性与差异特征的融合控制。在模拟与真实数据上的大量实验表明,所提方法优于当前主流方法。代码将发布于https://github.com/yuchenwang815/FCENet。
原文摘要 · Abstract (English)
Existing single-image denoising algorithms often struggle to restore details when dealing with complex noisy images. The introduction of near-infrared (NIR) images offers new possibilities for RGB image denoising. However, due to the inconsistency between NIR and RGB images, the existing works still struggle to balance the contributions of two fields in the process of image fusion. In response to this, in this paper, we develop a cross-field Frequency Correlation Exploiting Network (FCENet) for NIR-assisted image denoising. We first propose the frequency correlation prior based on an in-depth statistical frequency analysis of NIR-RGB image pairs. The prior reveals the complementary correlation of NIR and RGB images in the frequency domain. Leveraging frequency correlation prior, we then establish a frequency learning framework composed of Frequency Dynamic Selection Mechanism (FDSM) and Frequency Exhaustive Fusion Mechanism (FEFM). FDSM dynamically selects complementary information from NIR and RGB images in the frequency domain, and FEFM strengthens the control of common and differential features during the fusion process of NIR and RGB features. Extensive experiments on simulated and real data validate that the proposed method outperforms other state-of-the-art methods. The code will be released at https://github.com/yuchenwang815/FCENet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。