无需训练即可精准控制生成过程,适用于复杂几何空间。
Training Free Guided Flow Matching with Optimal Control
- 基于最优控制理论构建无训练引导生成框架
- 在图像、分子和肽段生成中均优于现有方法
- 特别适合蛋白质设计等高风险科学应用
预训练的扩散模型和流匹配模型在可控生成中具有广泛应用。一种常见策略是优化目标损失 $R(x_1)$,同时保持与先验分布接近。近期工作表明,通过反向传播穿越ODE采样过程可有效引导流模型。尽管性能优越,该类方法的理论理解仍不充分,存在改进空间。此外,现有方法主要针对欧几里得数据流形,而对复杂几何如SO(3)上的引导生成需求迫切,这在蛋白质设计等高风险科学应用中尤为关键。本文提出OC-Flow,一个通用且理论严谨的无训练引导流匹配框架。基于最优控制理论,我们开发了高效实用的算法,用于求解引导型ODE生成中的最优控制问题,并系统分析了欧几里得与SO(3)情形下的收敛性保证。我们证明,现有反向传播穿越ODE方法可视为欧几里得情形下OC-Flow的特例。大量实验显示,OC-Flow在文本引导图像编辑、条件分子生成及全原子肽段设计任务中表现卓越。
原文摘要 · Abstract (English)
Controlled generation with pre-trained Diffusion and Flow Matching models has vast applications. One strategy for guiding ODE-based generative models is through optimizing a target loss $R(x_1)$ while staying close to the prior distribution. Along this line, some recent work showed the effectiveness of guiding flow model by differentiating through its ODE sampling process. Despite the superior performance, the theoretical understanding of this line of methods is still preliminary, leaving space for algorithm improvement. Moreover, existing methods predominately focus on Euclidean data manifold, and there is a compelling need for guided flow methods on complex geometries such as SO(3), which prevails in high-stake scientific applications like protein design. We present OC-Flow, a general and theoretically grounded training-free framework for guided flow matching using optimal control. Building upon advances in optimal control theory, we develop effective and practical algorithms for solving optimal control in guided ODE-based generation and provide a systematic theoretical analysis of the convergence guarantee in both Euclidean and SO(3). We show that existing backprop-through-ODE methods can be interpreted as special cases of Euclidean OC-Flow. OC-Flow achieved superior performance in extensive experiments on text-guided image manipulation, conditional molecule generation, and all-atom peptide design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。