arXiv:2510.11964eess.IV2025-10被引 3

用单次噪声测量训练扩散模型,实现图像修复。

Normalization-equivariant Diffusion Models: Learning Posterior Samplers From Noisy And Partial Measurements

  • 利用信号缩放与噪声强度的弱等变性设计鲁棒得分匹配
  • 在噪声水平低于训练数据时仍可有效生成,无需干净数据
  • 适合无干净数据、仅单源不完整测量的图像修复场景

扩散模型(DMs)在图像生成与修复中表现强劲,但传统方法依赖大量干净图像进行监督训练。在真实场景中,获取无噪声数据困难,常仅有噪声且可能不完整的测量数据。现有方法多需极低噪声或额外干净数据,或依赖多重互补采集过程,实用性受限。本文提出首个仅使用单一观测算子的噪声测量数据训练扩散模型的方法。首次揭示了扩散模型及最小均方误差去噪器存在信号幅度缩放与噪声强度变化之间的弱等变性。基于此理论,设计了一种泛化性强的去噪得分匹配策略,可在训练噪声水平以下的条件下有效工作。进一步结合等变成像框架,利用成像问题的内在不变性,实现从单源不完整且含噪声测量中学习图像修复扩散模型。在去噪、去马赛克和图像修补任务上进行了广泛实验,结果优于当前最先进方法。

原文摘要 · Abstract (English)

Diffusion models (DMs) have rapidly emerged as a powerful framework for image generation and restoration. However, existing DMs are primarily trained in a supervised manner by using a large corpus of clean images. This reliance on clean data poses fundamental challenges in many real-world scenarios, where acquiring noise-free data is hard or infeasible, and only noisy and potentially incomplete measurements are available. While some methods can train DMs using noisy data, they are generally effective only when the amount of noise is very mild or when some additional noise-free data is available. In addition, existing methods for training DMs from incomplete measurements require access to multiple complementary acquisition processes, an assumption that poses a significant practical limitation. Here we introduce the first approach for learning DMs for image restoration using only noisy measurement data from a single operator. As a first key contribution, we show that DMs, and more broadly minimum mean squared error denoisers, exhibit a weak form of scale equivariance linking rescaling in signal amplitude to changes in noise intensity. We then leverage this theoretical insight to develop a denoising score-matching strategy that generalizes robustly to noise levels lower than those present in the training data, thereby enabling the learning of DMs from noisy measurements. To further address the challenges of incomplete and noisy data, we integrate our method with equivariant imaging, a complementary self-supervised learning framework that exploits the inherent invariants of imaging problems, to train DMs for image restoration from single-operator measurements that are both incomplete and noisy. We validate the effectiveness of our approach through extensive experiments on image denoising, demosaicing, and inpainting, along with comparisons with the state of the art.

扩散模型图像修复自监督学习等变性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。