arXiv:2505.05215cs.CV2025-05综述被引 6

系统梳理扩散模型量化最新进展,助力生成模型在边缘设备高效部署。

Diffusion Model Quantization: A Review

  • 分类总结扩散模型量化主流方法及其原理。
  • 在多个数据集上对比评估量化方案性能,涵盖定性和定量分析。
  • 适合关注生成模型压缩与边缘推理的研究者与工程师。

大型文本到图像模型的成功已实证扩散模型在生成任务中的卓越表现。为实现其在资源受限的边缘设备上的高效部署,模型量化成为压缩与加速的关键技术。本综述全面回顾了扩散模型量化领域的最新进展,涵盖当前最先进的研究成果。首先,概述了扩散模型量化面临的核心挑战,包括基于U-Net架构和Diffusion Transformers(DiT)的模型。接着,提出一套全面的量化技术分类体系,并深入探讨其底层原理。随后,从定性和定量两个角度详尽分析代表性量化方案。定量方面,在广泛使用的数据集上严格基准测试多种方法,对近期重要研究进行系统评估;定性方面,分类归纳量化误差影响,结合视觉结果与生成轨迹分析揭示其作用机制。最后,展望未来研究方向,提出生成模型量化在实际应用中的新路径。相关论文、代码、预训练模型及对比结果均公开于项目主页:https://github.com/TaylorJocelyn/Diffusion-Model-Quantization。

原文摘要 · Abstract (English)

Recent success of large text-to-image models has empirically underscored the exceptional performance of diffusion models in generative tasks. To facilitate their efficient deployment on resource-constrained edge devices, model quantization has emerged as a pivotal technique for both compression and acceleration. This survey offers a thorough review of the latest advancements in diffusion model quantization, encapsulating and analyzing the current state of the art in this rapidly advancing domain. First, we provide an overview of the key challenges encountered in the quantization of diffusion models, including those based on U-Net architectures and Diffusion Transformers (DiT). We then present a comprehensive taxonomy of prevalent quantization techniques, engaging in an in-depth discussion of their underlying principles. Subsequently, we perform a meticulous analysis of representative diffusion model quantization schemes from both qualitative and quantitative perspectives. From a quantitative standpoint, we rigorously benchmark a variety of methods using widely recognized datasets, delivering an extensive evaluation of the most recent and impactful research in the field. From a qualitative standpoint, we categorize and synthesize the effects of quantization errors, elucidating these impacts through both visual analysis and trajectory examination. In conclusion, we outline prospective avenues for future research, proposing novel directions for the quantization of generative models in practical applications. The list of related papers, corresponding codes, pre-trained models and comparison results are publicly available at the survey project homepage https://github.com/TaylorJocelyn/Diffusion-Model-Quantization.

扩散模型模型量化边缘计算生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。