arXiv:2608.13932cs.LG2026-08

提出HyGenQ框架,实现混合生成模型的高效8位量化,避免模型崩溃。

Post-training Quantization for Hybrid Iterative Generative Models

论文配图:Post-training Quantization for Hybrid Iterative Generative Models
图 1 · 摘自论文原文
  • 通过分层聚类分离异常激活通道,保留正常精度。
  • 引入缩放重校准,抑制量化误差引发的异常放大。
  • 可稳定量化多种混合生成模型至8位,适合部署加速场景。

迭代生成模型(IGMs)涵盖自回归与扩散范式,其混合变体能实现高保真图像生成。然而,迭代推理带来巨大计算开销,后训练量化(PTQ)成为加速理想选择,但直接应用传统PTQ会导致模型崩溃。分析发现两大关键挑战:激活中过多异常值(EOs)导致精度与覆盖范围难以兼顾,严重降低生成质量;微小量化误差引发不可预测的异常放大(AAs),造成校准与推理不匹配,迭代中触发模型崩溃。为此,提出HyGenQ框架,包含分层聚类解耦(HCD)与缩放重校准(SR)。HCD通过多阶段聚类识别并分离异常通道,有效隔离EOs同时保持正常值精度,缓解性能下降;SR将AAs扩展至高斯边界外,避免激进截断引起的模型崩溃。大量实验表明,HyGenQ成功将代表性混合IGMs量化至8位(W8A8),显著优于现有基线,并在不同模型族中验证了鲁棒性。

原文摘要 · Abstract (English)

Iterative Generative Models (IGMs) span autoregressive and diffusion paradigms, and hybrid variants that couple them can achieve remarkable image-generation fidelity. However, their iterative inference incurs substantial computational overhead, making Post-training Quantization (PTQ) appealing for acceleration, while directly applying vanilla PTQ to hybrid IGMs can trigger model collapse. By analyzing these failures, we identify two critical challenges: Excessive Outliers (EOs) in the activations create an irreconcilable trade-off between preserving normal precision and covering EOs, resulting in severe degradation in generation quality; Amplified Anomalies (AAs) arising unpredictably from minor quantization errors, create a mismatch between calibration and inference, thus iteratively triggering model collapse. To address these challenges, we introduce HyGenQ, a PTQ framework for hybrid IGMs. HyGenQ comprises Hierarchical Cluster Decoupling (HCD) and Scaling Recalibration (SR). HCD identifies and decouples outlier channels via a multi-stage clustering process, effectively isolating EOs while maintaining normal value precision, thereby alleviating performance degradation. SR scales AAs beyond Gaussian Bound, thereby avoiding model collapse caused by aggressive truncation. Extensive experiments demonstrate that HyGenQ successfully quantizes representative hybrid IGMs to 8-bit precision (W8A8), significantly outperforming existing baselines and validating its robustness across different model families.

量化生成模型混合架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。