仅用一对图像即可生成多种真实噪声,提升去噪模型泛化能力。
GuidNoise: Single-Pair Guided Diffusion for Generalized Noise Synthesis
- 用单对噪声/清晰图像引导扩散模型生成噪声
- 无需相机参数,在多种环境下生成高质量噪声图
- 适合数据少、轻量模型的实用去噪场景
近期图像去噪方法利用生成模型合成真实噪声以降低真实噪声数据采集成本。然而,这些生成模型通常需要相机元数据和大量目标特定的噪声-清晰图像对,跨设置泛化能力有限。本文提出一种单对引导扩散模型 GuidNoise,仅需训练集中一对噪声/清晰图像作为引导,即可合成多样化的逼真噪声。为训练 GuidNoise,引入引导感知的仿射特征调制(GAFM)和噪声感知精炼损失,优化扩散模型反向过程,使其更擅长生成真实噪声分布。GuidNoise 在训练与推理阶段均无需额外元数据,可在多种噪声环境下生成高质量噪声图像。此外,该方法可高效生成噪声-清晰图像对,实现训练数据自增强,显著提升去噪性能,尤其在轻量模型和小样本场景下表现突出。代码已开源:https://github.com/chjinny/GuidNoise。
原文摘要 · Abstract (English)
Recent image denoising methods have leveraged generative modeling for real noise synthesis to address the costly acquisition of real-world noisy data. However, these generative models typically require camera metadata and extensive target-specific noisy-clean image pairs, often showing limited generalization between settings. In this paper, to mitigate the prerequisites, we propose a Single-Pair Guided Diffusion for generalized noise synthesis GuidNoise, which uses a single noisy/clean pair as the guidance, often easily obtained by itself within a training set. To train GuidNoise, which generates synthetic noisy images from the guidance, we introduce a guidance-aware affine feature modification (GAFM) and a noise-aware refine loss to leverage the inherent potential of diffusion models. This loss function refines the diffusion model's backward process, making the model more adept at generating realistic noise distributions. The GuidNoise synthesizes high-quality noisy images under diverse noise environments without additional metadata during both training and inference. Additionally, GuidNoise enables the efficient generation of noisy-clean image pairs at inference time, making synthetic noise readily applicable for augmenting training data. This self-augmentation significantly improves denoising performance, especially in practical scenarios with lightweight models and limited training data. The code is available at https://github.com/chjinny/GuidNoise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。