arXiv:2602.09041cs.SDcs.AI2026-02

DSFlow让语音合成一步完成,还更稳定高效。

DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis

  • 将生成改为离散预测,用双监督确保每步输出一致。
  • 一步合成音质媲美多步,参数减少且推理更快。
  • 适合追求低延迟高效率语音合成的开发者。

基于流匹配的语音合成模型虽能生成高质量语音,但推理时需多次迭代,计算成本高。现有蒸馏方法常因端点误差累积导致过程不稳,且直接沿用连续时间架构会带来结构参数浪费。为此,我们提出DSFlow,一种针对少步和一步合成的模块化蒸馏框架。它将生成过程重构为离散预测任务,并通过双监督策略——端点匹配与确定性均速对齐——提升训练稳定性,保证各推理步骤间生成轨迹一致。同时,用轻量级步感知标记替代连续时间步条件,使模型容量适配离散任务的大幅缩减的时间步空间,提升参数效率。在多种基于流的语音合成架构上进行的大量实验表明,DSFlow持续优于标准蒸馏方法,在实现强少步与一步合成质量的同时,显著降低模型参数与推理开销。

原文摘要 · Abstract (English)

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference steps, existing methods often suffer from process variance due to endpoint error accumulation. Moreover, directly reusing continuous-time architectures for discrete, fixed-step generation introduces structural parameter inefficiencies. To address these challenges, we introduce DSFlow, a modular distillation framework for few-step and one-step synthesis. DSFlow reformulates generation as a discrete prediction task and explicitly adapts the student model to the target inference regime. It improves training stability through a dual supervision strategy that combines endpoint matching with deterministic mean-velocity alignment, enforcing consistent generation trajectories across inference steps. In addition, DSFlow improves parameter efficiency by replacing continuous-time timestep conditioning with lightweight step-aware tokens, aligning model capacity with the significantly reduced timestep space of the discrete task. Extensive experiments across diverse flow-based text-to-speech architectures demonstrate that DSFlow consistently outperforms standard distillation approaches, achieving strong few-step and one-step synthesis quality while reducing model parameters and inference cost.

语音合成流匹配蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。