提出新型生成模型训练框架,实现高效一键生成语音。
SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling
- 基于区间拆分一致性原则,构建无需微分运算的生成训练方法
- 一两步生成速度提升20倍,已在实际语音产品中部署
- 方法更稳定、兼容性好,适合大规模工业应用
生成模型如流匹配已达到顶尖性能,但常受限于计算成本高昂的迭代采样过程。近期工作聚焦于通过学习平均速度场实现少步或一步生成,直接将噪声映射到数据。其中,领先方法 MeanFlow 通过连接平均与瞬时速度的微分恒等式来学习该场。本文认为此微分形式是更根本原理的特殊情形,回归平均速度的第一性原理,利用定积分的可加性,推导出一种全新的纯代数恒等式——区间拆分一致性。该恒等式在不同时间区间间建立平均速度场的自指关系,无需微分算子。基于此,我们提出 SplitMeanFlow 训练框架,直接以该代数一致性作为学习目标。我们严格证明了 MeanFlow 的微分恒等式可通过区间分割趋于无穷小时的极限获得,确立 SplitMeanFlow 为学习平均速度场的更一般基础。从实践看,该代数方法显著高效,避免了 JVP 计算,实现更简实现、更稳训练和更广硬件兼容性。一、两步 SplitMeanFlow 模型已在大规模语音合成产品(如 Doubao)中成功部署,实现 20 倍加速。
原文摘要 · Abstract (English)
Generative models like Flow Matching have achieved state-of-the-art performance but are often hindered by a computationally expensive iterative sampling process. To address this, recent work has focused on few-step or one-step generation by learning the average velocity field, which directly maps noise to data. MeanFlow, a leading method in this area, learns this field by enforcing a differential identity that connects the average and instantaneous velocities. In this work, we argue that this differential formulation is a limiting special case of a more fundamental principle. We return to the first principles of average velocity and leverage the additivity property of definite integrals. This leads us to derive a novel, purely algebraic identity we term Interval Splitting Consistency. This identity establishes a self-referential relationship for the average velocity field across different time intervals without resorting to any differential operators. Based on this principle, we introduce SplitMeanFlow, a new training framework that enforces this algebraic consistency directly as a learning objective. We formally prove that the differential identity at the core of MeanFlow is recovered by taking the limit of our algebraic consistency as the interval split becomes infinitesimal. This establishes SplitMeanFlow as a direct and more general foundation for learning average velocity fields. From a practical standpoint, our algebraic approach is significantly more efficient, as it eliminates the need for JVP computations, resulting in simpler implementation, more stable training, and broader hardware compatibility. One-step and two-step SplitMeanFlow models have been successfully deployed in large-scale speech synthesis products (such as Doubao), achieving speedups of 20x.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。