arXiv:2509.01624cs.CVcs.AI2025-09被引 2

通过调整采样轨迹,实现少步扩散模型的4倍压缩与高保真生成。

Q-Sched: Pushing the Boundaries of Few-Step Diffusion Models with Quantization-Aware Scheduling

  • 不改权重,仅优化扩散调度器,实现量化感知的少步生成。
  • 4步模型FID提升15.5%,8步模型提升16.6%,媲美全精度性能。
  • 仅需少量提示词校准,无需全精度推理,适合移动端部署。

文本到图像扩散模型计算成本高昂,例如Stable Diffusion XL需对26亿参数模型进行50次前向传播才能生成高质量图像,即使单批次也代价巨大。少步扩散模型将过程缩短至2-8步,但仍依赖大型未压缩U-Net或扩散Transformer,全精度推理往往需数据中心级GPU支持。现有后训练量化方法依赖全精度校准,难以落地。本文提出Q-Sched,一种新范式:不修改模型权重,而是调整扩散调度器。通过优化少步采样路径,实现4倍模型压缩的同时保持全精度准确率。为学习量化感知的预处理系数,提出无参考的JAQ损失函数,融合文本-图像匹配度与图像质量指标,仅需少量校准提示词即可完成优化。实验显示,Q-Sched在4步潜空间一致性模型上比FP16基线提升15.5% FID,8步相位一致性模型提升16.6%,证明量化与少步蒸馏可互补。超过8万次用户标注的大规模评估进一步验证其在FLUX.1[schnell]与SDXL-Turbo上的有效性。

原文摘要 · Abstract (English)

Text-to-image diffusion models are computationally intensive, often requiring dozens of forward passes through large transformer backbones. For instance, Stable Diffusion XL generates high-quality images with 50 evaluations of a 2.6B-parameter model, an expensive process even for a single batch. Few-step diffusion models reduce this cost to 2-8 denoising steps but still depend on large, uncompressed U-Net or diffusion transformer backbones, which are often too costly for full-precision inference without datacenter GPUs. These requirements also limit existing post-training quantization methods that rely on full-precision calibration. We introduce Q-Sched, a new paradigm for post-training quantization that modifies the diffusion model scheduler rather than model weights. By adjusting the few-step sampling trajectory, Q-Sched achieves full-precision accuracy with a 4x reduction in model size. To learn quantization-aware pre-conditioning coefficients, we propose the JAQ loss, which combines text-image compatibility with an image quality metric for fine-grained optimization. JAQ is reference-free and requires only a handful of calibration prompts, avoiding full-precision inference during calibration. Q-Sched delivers substantial gains: a 15.5% FID improvement over the FP16 4-step Latent Consistency Model and a 16.6% improvement over the FP16 8-step Phased Consistency Model, showing that quantization and few-step distillation are complementary for high-fidelity generation. A large-scale user study with more than 80,000 annotations further confirms Q-Sched's effectiveness on both FLUX.1[schnell] and SDXL-Turbo.

扩散模型量化少步生成调度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。