arXiv:2602.09883cs.CV2026-02被引 3

针对扩散模型推理效率难题,提出动态量化方法提升性能与速度平衡。

AdaTSQ: Pushing the Pareto Frontier of Diffusion Transformers via Temporal-Sensitivity Quantization

  • 根据时间步敏感度动态分配不同层的量化位宽
  • 在多个扩散模型上实现更高图像质量与更低延迟
  • 适合边缘设备部署的高效生成模型研究者

扩散变换器(DiTs)已成为高质量图像和视频生成的最先进骨干网络,但其巨大的计算开销和内存占用限制了在边缘设备上的部署。尽管后训练量化(PTQ)在大语言模型中表现良好,但直接应用于DiTs效果不佳,因其忽略了扩散过程特有的时间动态特性。本文提出AdaTSQ,一种新型PTQ框架,通过利用DiTs的时间敏感性,推动效率与质量的帕累托前沿。首先,提出帕累托感知的时间步动态位宽分配策略,将量化策略搜索建模为约束路径规划问题,采用由端到端重建误差引导的束搜索算法,动态分配不同时间步的层内位宽。其次,提出基于费舍尔信息的时间校准机制,利用时间维度的费舍尔信息优先选择敏感时间步的校准数据,与基于海塞矩阵的权重优化无缝集成。在四个先进DiTs(如Flux-Dev、Flux-Schnell、Z-Image和Wan2.1)上的大量实验表明,AdaTSQ显著优于SVDQuant和ViDiT-Q等现有方法。代码将开源于https://github.com/Qiushao-E/AdaTSQ。

原文摘要 · Abstract (English)

Diffusion Transformers (DiTs) have emerged as the state-of-the-art backbone for high-fidelity image and video generation. However, their massive computational cost and memory footprint hinder deployment on edge devices. While post-training quantization (PTQ) has proven effective for large language models (LLMs), directly applying existing methods to DiTs yields suboptimal results due to the neglect of the unique temporal dynamics inherent in diffusion processes. In this paper, we propose AdaTSQ, a novel PTQ framework that pushes the Pareto frontier of efficiency and quality by exploiting the temporal sensitivity of DiTs. First, we propose a Pareto-aware timestep-dynamic bit-width allocation strategy. We model the quantization policy search as a constrained pathfinding problem. We utilize a beam search algorithm guided by end-to-end reconstruction error to dynamically assign layer-wise bit-widths across different timesteps. Second, we propose a Fisher-guided temporal calibration mechanism. It leverages temporal Fisher information to prioritize calibration data from highly sensitive timesteps, seamlessly integrating with Hessian-based weight optimization. Extensive experiments on four advanced DiTs (e.g., Flux-Dev, Flux-Schnell, Z-Image, and Wan2.1) demonstrate that AdaTSQ significantly outperforms state-of-the-art methods like SVDQuant and ViDiT-Q. Our code will be released at https://github.com/Qiushao-E/AdaTSQ.

扩散模型量化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。