arXiv:2507.16782cs.CV2025-07中稿 · ICCV

用合成数据实现目标检测模型的零样本量化训练,无需真实训练数据。

Task-Specific Zero-shot Quantization-Aware Training for Object Detection

  • 基于预训练模型生成带框和类别的任务专用合成数据。
  • 在MS-COCO和Pascal VOC上达到当前最优量化检测性能。
  • 适合隐私敏感场景下的轻量化目标检测部署。

量化通过降低网络参数精度来减小模型规模和计算复杂度。传统量化方法依赖原始训练数据,但常因隐私或安全问题无法获取。零样本量化(ZSQ)利用预训练模型生成的合成数据,避免了对真实数据的需求。尽管已有研究将ZSQ扩展至目标检测,但现有方法使用无标签的通用合成图像,缺乏目标检测所需的具体信息,导致性能不佳。本文提出一种新型任务特定零样本量化感知训练框架,包含两个阶段:首先,设计边界框与类别采样策略,从预训练网络中生成任务特定的校准集,重建物体位置、尺寸和类别分布,无需先验知识;其次,将任务特定训练融入知识蒸馏过程,恢复量化检测网络的性能。在MS-COCO和Pascal VOC数据集上的大量实验表明,该方法高效且性能领先。代码已公开于:https://github.com/DFQ-Dojo/dfq-toolkit。

原文摘要 · Abstract (English)

Quantization is a key technique to reduce network size and computational complexity by representing the network parameters with a lower precision. Traditional quantization methods rely on access to original training data, which is often restricted due to privacy concerns or security challenges. Zero-shot Quantization (ZSQ) addresses this by using synthetic data generated from pre-trained models, eliminating the need for real training data. Recently, ZSQ has been extended to object detection. However, existing methods use unlabeled task-agnostic synthetic images that lack the specific information required for object detection, leading to suboptimal performance. In this paper, we propose a novel task-specific ZSQ framework for object detection networks, which consists of two main stages. First, we introduce a bounding box and category sampling strategy to synthesize a task-specific calibration set from the pre-trained network, reconstructing object locations, sizes, and category distributions without any prior knowledge. Second, we integrate task-specific training into the knowledge distillation process to restore the performance of quantized detection networks. Extensive experiments conducted on the MS-COCO and Pascal VOC datasets demonstrate the efficiency and state-of-the-art performance of our method. Our code is publicly available at: https://github.com/DFQ-Dojo/dfq-toolkit .

目标检测量化零样本知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。