提出首个通用流匹配引导框架,提升生成质量与适用性。
On the Guidance of Flow Matching
- 构建通用流匹配引导框架,统一多种引导方法
- 提出无需训练的渐近精确引导,性能优于经典方法
- 适用于图像逆问题与离线强化学习等场景
流匹配在图像生成到决策任务等多种生成任务中表现优异,其中能量引导(简称引导)起关键作用。然而,流匹配的引导机制比其前身扩散模型更通用且差异显著,因此通用流匹配的引导问题尚未充分探索。本文首次提出通用流匹配引导的完整框架,从中推导出一系列可应用于通用流匹配的引导技术,包括一种无需训练的渐近精确引导、用于基于训练引导的新损失函数,以及两类涵盖经典梯度引导方法作为特例的近似引导。我们对这些方法进行理论分析,为不同场景下的方法选择提供实用指导。在合成数据集、图像逆问题和离线强化学习上的实验验证了所提引导方法的有效性,并证实了框架的正确性。代码可在 https://github.com/AI4Science-WestlakeU/flow_guidance 获取。
原文摘要 · Abstract (English)
Flow matching has shown state-of-the-art performance in various generative tasks, ranging from image generation to decision-making, where generation under energy guidance (abbreviated as guidance in the following) is pivotal. However, the guidance of flow matching is more general than and thus substantially different from that of its predecessor, diffusion models. Therefore, the challenge in guidance for general flow matching remains largely underexplored. In this paper, we propose the first framework of general guidance for flow matching. From this framework, we derive a family of guidance techniques that can be applied to general flow matching. These include a new training-free asymptotically exact guidance, novel training losses for training-based guidance, and two classes of approximate guidance that cover classical gradient guidance methods as special cases. We theoretically investigate these different methods to give a practical guideline for choosing suitable methods in different scenarios. Experiments on synthetic datasets, image inverse problems, and offline reinforcement learning demonstrate the effectiveness of our proposed guidance methods and verify the correctness of our flow matching guidance framework. Code to reproduce the experiments can be found at https://github.com/AI4Science-WestlakeU/flow_guidance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。