arXiv:2410.04479eess.IVcs.CV2024-10ICML被引 28

提出少步数的扩散采样方法,提升逆问题求解精度与速度。

SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems

  • 分步优化输入,三重一致性约束确保采样轨迹准确
  • 仅需少量反向步骤即达顶尖性能,运行更快
  • 适合图像重建等含噪声或非线性任务

扩散模型(DMs)是通过训练集学习分布并进行采样的生成模型。在求解逆问题时,通常修改反向采样过程以近似测量条件分布。然而,此类方法在存在测量噪声或非线性任务中表现不佳,常因早期误差无法修正,且需要大量优化或采样步骤。为此,本文提出了实现测量一致扩散轨迹的三个条件。基于此,我们提出一种新的基于优化的采样方法,不仅保持标准数据流形和前向扩散的一致性,还引入了分步网络正则化的反向扩散一致性,每步优化预训练模型的输入以维持扩散轨迹。通过隐式或显式施加这些条件,所提采样器显著减少反向步骤数量。因此命名为分步三重一致性采样(SITCOM)。在多种线性和非线性任务(含自然图像与医学图像)上,相比最先进基线,SITCOM 在标准相似性指标和运行时间上均达到竞争性或更优表现。

原文摘要 · Abstract (English)

Diffusion models (DMs) are a class of generative models that allow sampling from a distribution learned over a training set. When applied to solving inverse problems, the reverse sampling steps are modified to approximately sample from a measurement-conditioned distribution. However, these modifications may be unsuitable for certain settings (e.g., presence of measurement noise) and non-linear tasks, as they often struggle to correct errors from earlier steps and generally require a large number of optimization and/or sampling steps. To address these challenges, we state three conditions for achieving measurement-consistent diffusion trajectories. Building on these conditions, we propose a new optimization-based sampling method that not only enforces standard data manifold measurement consistency and forward diffusion consistency, as seen in previous studies, but also incorporates our proposed step-wise and network-regularized backward diffusion consistency that maintains a diffusion trajectory by optimizing over the input of the pre-trained model at every sampling step. By enforcing these conditions (implicitly or explicitly), our sampler requires significantly fewer reverse steps. Therefore, we refer to our method as Step-wise Triple-Consistent Sampling (SITCOM). Compared to SOTA baselines, our experiments across several linear and non-linear tasks (with natural and medical images) demonstrate that SITCOM achieves competitive or superior results in terms of standard similarity metrics and run-time.

扩散模型逆问题图像重建高效采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。