arXiv:2506.02680cs.CVeess.IV2025-06NeurIPS被引 17

用流模型做图像逆问题重建,无需训练就能高保真还原。

Solving Inverse Problems with FLAIR

  • 设计新变分框架,让流模型直接当先验,不需重新训练。
  • 在多个标准数据集上,重建质量与样本多样性均优于现有方法。
  • 适合图像修复、去模糊等逆问题,尤其看重生成质量的场景。

基于流的潜在生成模型(如 Stable Diffusion 3)能生成高质量图像,甚至实现逼真的文生图。这表明它们应可作为逆成像问题的强大先验,但实际应用中尚未达到同等保真度。主要障碍包括:(i) 数据似然项通常不可计算;(ii) 学习到的生成模型无法直接以退化观测为条件,导致数据拟合与先验之间目标冲突;(iii) 重建结果可能偏离真实观测。本文提出 FLAIR,一种无需训练的变分框架,利用流模型作为逆问题的先验。我们引入一种对退化类型无关的流匹配变分目标,并结合确定性轨迹调整,引导先验朝后验更可能的区域移动。为保证与观测数据完全一致,我们解耦数据保真与正则化项的优化。此外,引入时间依赖的校准机制,根据离线精度估计动态调节正则化强度。在标准成像基准测试中,FLAIR 在重建质量与样本多样性上持续优于现有的扩散模型与流模型方法。代码已公开于 https://inverseflair.github.io/。

原文摘要 · Abstract (English)

Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also constitute powerful priors for inverse imaging problems, but that approach has not yet led to comparable fidelity. There are several key obstacles: (i) the data likelihood term is usually intractable; (ii) learned generative models cannot be directly conditioned on the distorted observations, leading to conflicting objectives between data likelihood and prior; and (iii) the reconstructions can deviate from the observed data. We present FLAIR, a novel, training-free variational framework that leverages flow-based generative models as prior for inverse problems. To that end, we introduce a variational objective for flow matching that is agnostic to the type of degradation, and combine it with deterministic trajectory adjustments to guide the prior towards regions which are more likely under the posterior. To enforce exact consistency with the observed data, we decouple the optimization of the data fidelity and regularization terms. Moreover, we introduce a time-dependent calibration scheme in which the strength of the regularization is modulated according to off-line accuracy estimates. Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity. Our code is available at https://inverseflair.github.io/.

逆问题流模型图像重建生成先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。