arXiv:2507.21947cs.CVcs.AI2025-07ICCV被引 1

用混合类别提示生成更鲁棒的合成数据,提升无数据量化泛化能力

Enhancing Generalization in Data-free Quantization via Mixup-class Prompting

  • 在文本提示层融合多类标签生成合成图像
  • 2比特权值+4比特激活下达到新SOTA性能
  • 适合隐私敏感场景下的模型压缩与部署

训练后量化(PTQ)虽能提升效率,但在校准数据有限时表现不佳,尤其在隐私约束下。无数据量化(DFQ)通过生成对抗网络(GANs)和文本条件扩散模型(LDMs)生成合成图像,结合现有PTQ算法缓解此问题。然而,生成图像与量化模型泛化能力之间的关系尚未深入研究。此前基于单类提示的方法因语义歧义导致性能下降。本文提出混合类别提示(mixup-class prompt),在文本提示层面融合多个类别标签,生成更具多样性和鲁棒性的合成数据,增强泛化性并提升PTQ优化稳定性。通过梯度范数与泛化误差分析提供定量验证。在卷积神经网络(CNNs)和视觉变换器(ViTs)上的实验表明,该方法持续优于当前最优的DFQ方法(如GenQ),并在极端低比特场景(2比特权值、4比特激活)中实现新纪录,显著推动了低比特量化性能边界。

原文摘要 · Abstract (English)

Post-training quantization (PTQ) improves efficiency but struggles with limited calibration data, especially under privacy constraints. Data-free quantization (DFQ) mitigates this by generating synthetic images using generative models such as generative adversarial networks (GANs) and text-conditioned latent diffusion models (LDMs), while applying existing PTQ algorithms. However, the relationship between generated synthetic images and the generalizability of the quantized model during PTQ remains underexplored. Without investigating this relationship, synthetic images generated by previous prompt engineering methods based on single-class prompts suffer from issues such as polysemy, leading to performance degradation. We propose \textbf{mixup-class prompt}, a mixup-based text prompting strategy that fuses multiple class labels at the text prompt level to generate diverse, robust synthetic data. This approach enhances generalization, and improves optimization stability in PTQ. We provide quantitative insights through gradient norm and generalization error analysis. Experiments on convolutional neural networks (CNNs) and vision transformers (ViTs) show that our method consistently outperforms state-of-the-art DFQ methods like GenQ. Furthermore, it pushes the performance boundary in extremely low-bit scenarios, achieving new state-of-the-art accuracy in challenging 2-bit weight, 4-bit activation (W2A4) quantization.

量化无数据扩散模型视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。