用现成生成模型实现物体检测器零样本量化,支持极低比特部署。
Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models

- 利用现成生成模型构建带标注的合成训练集,解决无原始数据时的量化难题。
- 在W4A4和更极端的W3A3比特下均达到当前最优性能。
- 适合边缘设备部署需求,尤其适用于缺乏训练数据的场景。
随着物体检测模型在边缘设备上日益普及,当无法访问原始训练数据时,零样本量化(ZSQ-OD)成为关键挑战。现有方法通过噪声优化生成训练集,但在低比特条件下性能下降明显。本文提出GoodQ(基于现成生成模型的检测器量化),利用预训练生成模型构建合成数据集。针对三个核心问题:图像中实例密集、类别分布不均、伪标签引入噪声,GoodQ分别设计信息密集提示策略、内在分布感知选择机制和教师引导自适应降噪方法。实验表明,该框架在低比特(如W4A4)及极端比特(如W3A3)下均达到领先性能,并通过系统分析揭示了其有效性的内在因素。
原文摘要 · Abstract (English)
With an increasing number of Object Detection (OD) models being deployed on edge devices, Zero-Shot Quantization for OD (ZSQ-OD) aims to quantize these models when access to the original training data is prohibited. Existing research on Zero-Shot Quantization-Aware Training (QAT) for OD synthesizes training sets through noise optimization. However, this approach struggles to maintain performance in low-bit regions. In this paper, we introduce GoodQ (Generative off-the-shelf models for object detector Quantization), a QAT pipeline that utilizes off-the-shelf generative models to construct a training set. We first identify three challenges that arise when introducing a generative model to the ZSQ-OD task: 1) each image contains dense information with multiple instances, 2) the class-wise distribution in the original dataset is imbalanced, and 3) the pseudo-labels assigned to the generated images can potentially act as noisy signals during QAT. GoodQ addresses these challenges by 1) introducing an Information-Dense Prompting strategy to generate multi-instance images, 2) applying Intrinsic Distribution-Aware Selection to match the pretrained class distribution, and 3) employing Teacher-guided Adaptive Noise Reduction to mitigate noise arising from the QAT process. Our framework achieves state-of-the-art performance in low-bit ZSQ (W4A4) and extends quantization to extreme bit-widths (W3A3). Furthermore, we conduct an extensive analysis to uncover the underlying factors contributing to the efficacy of GoodQ.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。