arXiv:2503.08136cs.CVcs.AI2025-03ICCV被引 65

用流模型解决逆问题,无需训练就能超越现有方法。

FlowDPS: Flow-Driven Posterior Sampling for Inverse Problems

  • 将扩散模型的后验采样思路迁移到流模型,拆分去噪与噪声估计
  • 在四个线性逆问题上性能优于当前最优方法,且无需额外训练
  • 可无缝集成到Transformer架构的潜在流模型中,适合图像重建任务

流匹配是基于常微分方程(ODE)的生成建模最新框架,相较于扩散模型更具通用性。尽管扩散模型已广泛用于逆问题求解,但流模型在此领域的系统研究尚不充分。本文将扩散逆求解器(DIS)——通过结合去噪扩散先验与似然梯度实现后验采样——拓展至流模型框架。具体而言,通过驱动流版本的Tweedie公式,将流ODE分解为两个部分:一个用于干净图像估计,另一个用于噪声估计。分别在各部分中融入似然梯度和随机噪声,证明了流模型可有效实现逆问题的后验采样。所提出的Flow-Driven Posterior Sampling(FlowDPS)方法可无缝集成至具有Transformer结构的潜在流模型中。在四个线性逆问题上,实验表明FlowDPS性能优于现有最先进方法,且无需任何额外训练。

原文摘要 · Abstract (English)

Flow matching is a recent state-of-the-art framework for generative modeling based on ordinary differential equations (ODEs). While closely related to diffusion models, it provides a more general perspective on generative modeling. Although inverse problem solving has been extensively explored using diffusion models, it has not been rigorously examined within the broader context of flow models. Therefore, here we extend the diffusion inverse solvers (DIS) - which perform posterior sampling by combining a denoising diffusion prior with an likelihood gradient - into the flow framework. Specifically, by driving the flow-version of Tweedie's formula, we decompose the flow ODE into two components: one for clean image estimation and the other for noise estimation. By integrating the likelihood gradient and stochastic noise into each component, respectively, we demonstrate that posterior sampling for inverse problem solving can be effectively achieved using flows. Our proposed solver, Flow-Driven Posterior Sampling (FlowDPS), can also be seamlessly integrated into a latent flow model with a transformer architecture. Across four linear inverse problems, we confirm that FlowDPS outperforms state-of-the-art alternatives, all without requiring additional training.

逆问题流模型后验采样图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。