用噪声空间的Langevin动态实现高效后验采样,无需重复生成全过程。
Posterior sampling via Langevin dynamics based on generative priors
- 在预训练生成模型的噪声空间中模拟Langevin动力学,直接采样后验分布。
- 在有限函数评估下生成高保真且语义多样图像,比扩散模型更高效。
- 适用于图像修复等逆问题,尤其适合需快速生成多样的场景。
在高维空间中利用生成模型进行后验采样在逆问题和引导生成任务中具有重要意义。尽管已有诸多进展,现有方法仍面临生成多样性不足的挑战,因每次新样本需重新运行完整采样过程,计算开销大。本文提出一种基于预训练生成模型噪声空间的Langevin动力学后验采样方法,通过蒸馏流或一致性模型建立噪声与数据空间间的映射,实现无需重跑完整采样链的无缝后验探索,显著降低计算成本。理论上,我们证明了该噪声空间Langevin动态在生成模型充分逼近先验分布的前提下,可有效近似后验分布。实验在包含噪声线性和非线性前向算子的图像修复任务上验证,使用LSUN-Bedroom(256×256)和ImageNet(64×64)数据集,结果表明该方法在有限函数评估次数下仍能生成高保真、语义多样图像,相较现有基于扩散模型的后验采样技术在效率和性能上均表现更优。
原文摘要 · Abstract (English)
Posterior sampling in high-dimensional spaces using generative models holds significant promise for various applications, including but not limited to inverse problems and guided generation tasks. Despite many recent developments, generating diverse posterior samples remains a challenge, as existing methods require restarting the entire generative process for each new sample, making the procedure computationally expensive. In this work, we propose efficient posterior sampling by simulating Langevin dynamics in the noise space of a pre-trained generative model. By exploiting the mapping between the noise and data spaces which can be provided by distilled flows or consistency models, our method enables seamless exploration of the posterior without the need to re-run the full sampling chain, drastically reducing computational overhead. Theoretically, we prove a guarantee for the proposed noise-space Langevin dynamics to approximate the posterior, assuming that the generative model sufficiently approximates the prior distribution. Our framework is experimentally validated on image restoration tasks involving noisy linear and nonlinear forward operators applied to LSUN-Bedroom (256 x 256) and ImageNet (64 x 64) datasets. The results demonstrate that our approach generates high-fidelity samples with enhanced semantic diversity even under a limited number of function evaluations, offering superior efficiency and performance compared to existing diffusion-based posterior sampling techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。