arXiv:2508.15093cs.CV2025-08被引 10

通过引导轨迹曲率提升图文生成的语义一致性。

CurveFlow: Curvature-Guided Flow Matching for Image Generation

  • 引入曲率正则化,学习非线性平滑生成路径。
  • 在MS COCO上各项指标优于现有方法,尤其提升语义一致性。
  • 适合追求高指令遵循能力的文本到图像生成研究者。

现有的修正流模型基于数据分布与噪声分布间的线性轨迹,这种线性强制零曲率,可能导致生成过程经过数据流形中低概率区域。一个关键问题尚未深入探讨:轨迹曲率如何影响生成图像与对应文本描述之间的语义对齐,即指令遵循能力?为此,我们提出CurveFlow,一种新型流匹配框架,通过直接将曲率引导融入生成路径,学习平滑的非线性轨迹。该方法采用稳健的曲率正则化技术,惩罚轨迹内在动力学的突变。在MS COCO 2014和2017上的大量实验表明,CurveFlow在文本到图像生成任务中达到最先进性能,显著优于标准修正流变体及其他非线性基线(如Rectified Diffusion)。改进在BLEU、METEOR、ROUGE和CLAIR等语义一致性指标上尤为明显,证实曲率感知建模显著增强了模型忠实执行复杂指令的能力,同时保持高质量图像生成。代码已公开于https://github.com/Harvard-AI-and-Robotics-Lab/CurveFlow。

原文摘要 · Abstract (English)

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the data manifold. A key question remains underexplored: how does the curvature of these trajectories correlate with the semantic alignment between generated images and their corresponding captions, i.e., instructional compliance? To address this, we introduce CurveFlow, a novel flow matching framework designed to learn smooth, non-linear trajectories by directly incorporating curvature guidance into the flow path. Our method features a robust curvature regularization technique that penalizes abrupt changes in the trajectory's intrinsic dynamics.Extensive experiments on MS COCO 2014 and 2017 demonstrate that CurveFlow achieves state-of-the-art performance in text-to-image generation, significantly outperforming both standard rectified flow variants and other non-linear baselines like Rectified Diffusion. The improvements are especially evident in semantic consistency metrics such as BLEU, METEOR, ROUGE, and CLAIR. This confirms that our curvature-aware modeling substantially enhances the model's ability to faithfully follow complex instructions while simultaneously maintaining high image quality. The code is made publicly available at https://github.com/Harvard-AI-and-Robotics-Lab/CurveFlow.

图像生成流匹配曲率引导图文一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。