arXiv:2411.07625cs.CV2024-11被引 2

无需训练即可实现流模型条件生成,突破无显式得分函数限制

Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching

  • 通过修正速度场引入代理得分函数,衔接流模型与后验采样
  • 在多种条件生成任务中优于当前最佳方法,提升生成质量
  • 提供高质量与高效率两种实现,适配不同场景需求

基于流匹配的无训练条件生成旨在利用预训练的无条件流匹配模型进行条件生成而无需重新训练。近期成功的方法通过后验采样引入条件信息,但依赖无条件扩散模型中的显式得分函数,而流匹配模型并无显式得分函数,导致该策略无法适用。现有近似后验采样仅限于线性逆问题。本文提出基于流匹配的后验采样(FMPS),通过引导速度场引入修正项,可重构成代理得分函数,弥合流匹配模型与基于得分的后验采样之间的差距。因此,FMPS使后验采样可在流匹配框架内灵活调整。此外,我们提出两种实用的修正机制:一种提升生成质量,另一种优化计算效率。在多样化的条件生成任务上实验表明,本方法生成质量显著优于现有最先进方法,验证了FMPS的有效性与通用性。

原文摘要 · Abstract (English)

Training-free conditional generation based on flow matching aims to leverage pre-trained unconditional flow matching models to perform conditional generation without retraining. Recently, a successful training-free conditional generation approach incorporates conditions via posterior sampling, which relies on the availability of a score function in the unconditional diffusion model. However, flow matching models do not possess an explicit score function, rendering such a strategy inapplicable. Approximate posterior sampling for flow matching has been explored, but it is limited to linear inverse problems. In this paper, we propose Flow Matching-based Posterior Sampling (FMPS) to expand its application scope. We introduce a correction term by steering the velocity field. This correction term can be reformulated to incorporate a surrogate score function, thereby bridging the gap between flow matching models and score-based posterior sampling. Hence, FMPS enables the posterior sampling to be adjusted within the flow matching framework. Further, we propose two practical implementations of the correction mechanism: one aimed at improving generation quality, and the other focused on computational efficiency. Experimental results on diverse conditional generation tasks demonstrate that our method achieves superior generation quality compared to existing state-of-the-art approaches, validating the effectiveness and generality of FMPS.

流匹配条件生成无训练后验采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。