统一速度与终点预测,提升生成模型稳定性与质量。
Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models

- 联合训练网络预测速度和数据终点,引入一致性损失
- 生成路径更笔直,优化更稳定,图像质量显著提升
- 无需改动架构,计算开销极小,适合主流生成任务
在基于修正流的生成模型中,神经网络可训练为预测瞬时速度或数据终点以实现去噪。尽管已有研究指出不同参数化方式表现出不同经验行为,但其内在机制尚不明确,如何有效结合仍不清楚。本文分析了不同参数化学习误差对生成性能的影响,发现预测数据终点具有清晰的训练信号,有助于稳定训练;而预测速度则能保持靠近数据流形时的采样动态稳定。受此启发,提出自洽流(SC-Flow),通过轻量级一致性损失,使单一网络同时预测局部速度与数据终点,两者的协同优化提升了模型性能。该方法无需重大架构改动,计算开销极低。大量图像生成实验表明,SC-Flow显著稳定了优化过程,改善了生成路径的直线性,相比标准修正流基线带来了明显的生成质量提升。
原文摘要 · Abstract (English)
In rectified-flow-based generative models, the neural network can be trained to predict two different targets, such as the instantaneous velocity or the data endpoint, to perform denoising. Although prior work shows that these parameterizations lead to different empirical behaviors, the mechanisms underlying their respective advantages remain to be underexplored, and how to combine them effectively is still unclear. In this work, we analyze how learning errors from different parameterizations affect the generation performance. We show that predicting the data endpoint has a clear training signal that stabilizes training, whereas predicting the velocity maintains stable sampling dynamics near the data manifold. Motivated by these insights, we propose Self-Consistent Flow (SC-Flow), a new method that unifies the benefits of both parameterizations. By employing a lightweight consistency loss, SC-Flow jointly trains a single network to predict both the local velocity and the data endpoint, and the consistency between the two predictions improves the model's performance. The method requires no major architectural changes and adds minimal computational overhead. Extensive experiments on image generation tasks demonstrate that SC-Flow substantially stabilizes optimization and improves the straightness of generation paths, leading to significant gains in generation quality over standard rectified-flow baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。