arXiv:2503.21377cs.CV2025-03被引 1

用随机掩码让模型同时去噪和修复,无需成对数据也能提升真实图像降噪效果。

Unsupervised Real-World Denoising: Sparsity is All You Need

  • 通过随机掩码稀疏化输入,让模型在合成数据上同时学去噪与修复。
  • 迭代优化噪声采样器,使真实噪声分布逼近合成数据,提升泛化能力。
  • 适合无配对数据的图像去噪场景,尤其适用于真实世界复杂噪声。

真实世界图像去噪的监督训练面临配对数据难获取的问题。现有方法尝试使用无配对的干净与噪声图像数据集,通过生成合成干净-噪声对进行训练,但常因合成与真实噪声分布差异而表现不佳。为此,本文提出基于输入稀疏化的方案——掩码、修复、去噪(MID),利用随机输入掩码缩小合成与真实噪声间的差距。模型同时学习去噪与修复任务,利用未掩码像素预测缺失像素,实现高精度重建。方法从高斯噪声采样器出发,通过迭代方式优化:每轮用模型预测伪干净图减去真实噪声图,构建更精确的噪声数据集,并更新噪声采样器。核心思想是去噪性能提升可带来更准确的噪声数据,从而改进采样器。在多个真实世界噪声数据集上的实验表明,该方法在无监督条件下达到当前最优性能。

原文摘要 · Abstract (English)

Supervised training for real-world denoising presents challenges due to the difficulty of collecting large datasets of paired noisy and clean images. Recent methods have attempted to address this by utilizing unpaired datasets of clean and noisy images. Some approaches leverage such unpaired data to train denoisers in a supervised manner by generating synthetic clean-noisy pairs. However, these methods often fall short due to the distribution gap between synthetic and real noisy images. To mitigate this issue, we propose a solution based on input sparsification, specifically using random input masking. Our method, which we refer to as Mask, Inpaint and Denoise (MID), trains a denoiser to simultaneously denoise and inpaint synthetic clean-noisy pairs. On one hand, input sparsification reduces the gap between synthetic and real noisy images. On the other hand, an inpainter trained in a supervised manner can still accurately reconstruct sparse inputs by predicting missing clean pixels using the remaining unmasked pixels. Our approach begins with a synthetic Gaussian noise sampler and iteratively refines it using a noise dataset derived from the denoiser's predictions. The noise dataset is created by subtracting predicted pseudo-clean images from real noisy images at each iteration. The core intuition is that improving the denoiser results in a more accurate noise dataset and, consequently, a better noise sampler. We validate our method through extensive experiments on real-world noisy image datasets, demonstrating competitive performance compared to existing unsupervised denoising methods.

图像去噪无监督学习稀疏化自训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。