用非线性轨迹蒸馏,让文生图模型2步完成生成,速度快40倍
ArcFlow: Unleashing 2-Step Text-to-Image Generation via High-Precision Non-Linear Flow Distillation
- 用连续动量混合建模速度场,实现非线性生成轨迹
- 2次求解步骤下速度提升40倍,图像质量损失小
- 仅微调5%参数,适合大模型高效部署
扩散模型生成质量优异,但依赖多步去噪导致推理成本高。现有蒸馏方法多采用线性近似,难以匹配随时间变化的速度方向,造成质量下降。为此,我们提出ArcFlow,一种基于非线性流轨迹的少步蒸馏框架。ArcFlow将推理轨迹的速度场参数化为连续动量过程的混合形式,能捕捉速度演化,并在每一步内外推出连贯的速度,形成连续非线性轨迹。该参数化支持解析积分,避免数值离散误差,实现对教师模型轨迹的高精度逼近。通过轻量适配器在预训练教师模型上进行轨迹蒸馏训练,确保快速稳定收敛,同时保持生成多样性和质量。基于大规模模型(Qwen-Image-20B 和 FLUX.1-dev),ArcFlow仅微调不到5%的参数,在2个数值求解步数(NFEs)下实现40倍速度提升,且无显著质量损失。基准测试验证了其在定性和定量上的有效性。
原文摘要 · Abstract (English)
Diffusion models have achieved remarkable generation quality, but they suffer from significant inference cost due to their reliance on multiple sequential denoising steps, motivating recent efforts to distill this inference process into a few-step regime. However, existing distillation methods typically approximate the teacher trajectory by using linear shortcuts, which makes it difficult to match its constantly changing tangent directions as velocities evolve across timesteps, thereby leading to quality degradation. To address this limitation, we propose ArcFlow, a few-step distillation framework that explicitly employs non-linear flow trajectories to approximate pre-trained teacher trajectories. Concretely, ArcFlow parameterizes the velocity field underlying the inference trajectory as a mixture of continuous momentum processes. This enables ArcFlow to capture velocity evolution and extrapolate coherent velocities to form a continuous non-linear trajectory within each denoising step. Importantly, this parameterization admits an analytical integration of this non-linear trajectory, which circumvents numerical discretization errors and results in high-precision approximation of the teacher trajectory. To train this parameterization into a few-step generator, we implement ArcFlow via trajectory distillation on pre-trained teacher models using lightweight adapters. This strategy ensures fast, stable convergence while preserving generative diversity and quality. Built on large-scale models (Qwen-Image-20B and FLUX.1-dev), ArcFlow only fine-tunes on less than 5% of original parameters and achieves a 40x speedup with 2 NFEs over the original multi-step teachers without significant quality degradation. Experiments on benchmarks show the effectiveness of ArcFlow both qualitatively and quantitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。