利用近红外信号提升低光图像去噪,通过频率分解实现更精准的细节恢复。
Frequency-Decomposed INR for NIR-Assisted Low-Light RGB Image Denoising

- 将图像按频率分块,用RGB处理低频亮度颜色,NIR负责高频纹理重建。
- 在多个数据集上均优于现有方法,尤其在任意分辨率重建中表现突出。
- 自适应加权损失自动平衡不同频率任务,减少色彩失真和伪影。
针对低光照条件下可见图像中存在的严重噪声与高频结构退化问题,本文提出一种基于频率解耦隐式神经表示(FDINR)的近红外(NIR)辅助低光图像修复方法。基于RGB-NIR跨模态频率相关性的统计先验——即低频RGB信号更可靠,而高频NIR信号相关性更高,我们通过多尺度小波变换显式分解图像为不同频率成分,并构建双分支隐式神经表示框架。在此框架中,设计了跨模态差异化频率监督机制:利用低光RGB引导低频亮度与色彩重建,同时借助高信噪比(SNR)的NIR信号约束高频纹理生成,从而在频率域实现互补优势。此外,引入基于不确定性的自适应加权损失函数,自动平衡不同频率任务的贡献,解决了传统方法在空间域刚性融合导致的颜色失真与伪影问题。实验表明,FD-INR不仅有效恢复图像亮度一致性和结构细节,还因其隐式连续表示,在任意分辨率重建任务中显著超越现有方法,大幅提升了低光感知的可靠性。
原文摘要 · Abstract (English)
Addressing the issues of severe noise and high frequency structural degradation in visible images under low-light conditions, this paper proposes a Near Infrared (NIR) aided low light image restoration method based on Frequency Decoupled Implicit Neural Representation (FDINR). Based on the statistical prior of RGB-NIR cross-modal frequency correlations, specifically that low-frequency RGB signals are more reliable, whereas high frequency NIR signals exhibit higher correlation, we explicitly decompose images into distinct frequency components via multi-scale wavelet transforms and construct a dual-branch implicit neural representation framework. Within this framework, we design a cross modal differentiated frequency supervision mechanism, leveraging low light RGB to guide the reconstruction of low frequency luminance and color, and utilizing high-SNR NIR signals to constrain the generation of high frequency texture details, thereby achieving complementary advantages in the frequency domain. Furthermore, an uncertainty-based adaptive weighting loss function is introduced to automatically balance the contributions of different frequency tasks, solving the problems of color distortion and artifacts caused by rigid fusion in the spatial domain common in traditional methods. Experimental results demonstrate that FD-INR not only effectively restores image luminance consistency and structural details but also, benefitting from its implicit continuous representation, outperforms existing methods in arbitrary-resolution reconstruction tasks, significantly enhancing the reliability of low light perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。