用扩散模型生成真实低光噪声,提升图像去噪效果。
Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising
- 设计双分支架构分离信号相关与无关噪声
- 引入位置信息捕捉固定模式噪声,生成更逼真数据
- 自定义扩散过程,适合低光噪声特性,适用于算法研究者
低光摄影因光子有限导致信噪比低,传统高斯噪声模型失效,现有去噪方法性能受限。尽管深度学习表现良好,但需大量成对数据,难以获取。为此,合成真实低光噪声成为关键。本文研究扩散模型在建模复杂低光噪声分布中的能力,发现直接应用传统扩散模型效果不足,提出三项改进:采用双分支结构更好分离信号相关与信号无关噪声;引入位置信息以捕捉固定模式噪声;设计专用扩散噪声调度。所提方法可生成大规模高质量低光噪声数据集,用于训练去噪网络,实现当前最佳性能。通过统计评估与噪声分解分析,深入揭示生成数据特性。
原文摘要 · Abstract (English)
Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise effectively. Although deep-learning methods perform well, they require large datasets of paired images that are impractical to acquire. As a remedy, synthesizing realistic low-light noise has gained significant attention. In this paper, we investigate the ability of diffusion models to capture the complex distribution of low-light noise. We show that a naive application of conventional diffusion models is inadequate for this task and propose three key adaptations that enable high-precision noise generation: a two-branch architecture to better model signal-dependent and signal-independent noise, the incorporation of positional information to capture fixed-pattern noise, and a tailored diffusion noise schedule. Consequently, our model enables the generation of large datasets for training low-light denoising networks, leading to state-of-the-art performance. Through comprehensive analysis, including statistical evaluation and noise decomposition, we provide deeper insights into the characteristics of the generated data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。