arXiv:2510.20348cs.CV2025-10NeurIPS被引 1

提出AccuQuant量化方法,解决扩散模型采样中误差累积问题。

AccuQuant: Simulating Multiple Denoising Steps for Quantizing Diffusion Models

  • 模拟多步去噪过程优化量化,显式建模误差累积
  • 在多个基准上实现更高精度与更低内存开销
  • 适合需要高效部署扩散模型的场景

本文提出一种新的后训练量化(PTQ)方法AccuQuant,用于扩散模型。我们从理论上和实证上证明了扩散模型在采样过程中,量化误差会随去噪步骤累积。为缓解该问题,AccuQuant通过在若干去噪步骤内最小化全精度模型与量化版本输出之间的差异,显式模拟扩散采样中的多步去噪过程,从而考虑多步误差累积的影响。这与以往方法独立最小化每一步差异的做法形成对比。此外,我们还提出一种高效实现技术与新目标函数,将内存复杂度从 $\mathcal{O}(n)$ 显著降低至 $\mathcal{O}(1)$,其中 $n$ 为去噪步数。我们在多个任务和扩散模型的标准基准上验证了AccuQuant的有效性与效率。

原文摘要 · Abstract (English)

We present in this paper a novel post-training quantization (PTQ) method, dubbed AccuQuant, for diffusion models. We show analytically and empirically that quantization errors for diffusion models are accumulated over denoising steps in a sampling process. To alleviate the error accumulation problem, AccuQuant minimizes the discrepancies between outputs of a full-precision diffusion model and its quantized version within a couple of denoising steps. That is, it simulates multiple denoising steps of a diffusion sampling process explicitly for quantization, accounting the accumulated errors over multiple denoising steps, which is in contrast to previous approaches to imitating a training process of diffusion models, namely, minimizing the discrepancies independently for each step. We also present an efficient implementation technique for AccuQuant, together with a novel objective, which reduces a memory complexity significantly from $\mathcal{O}(n)$ to $\mathcal{O}(1)$, where $n$ is the number of denoising steps. We demonstrate the efficacy and efficiency of AccuQuant across various tasks and diffusion models on standard benchmarks.

扩散模型量化去噪部署优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。