arXiv:2507.17768cs.LGcs.CV2025-07被引 7

用小数据提升边缘设备低比特量化模型精度,解决隐私与算力双重难题。

Enhancing Quantization-Aware Training on Edge Devices via Relative Entropy Coreset Selection and Cascaded Layer Correction

  • 基于相对熵筛选最具代表性的数据子集,减少训练开销。
  • 2比特量化下,1%数据仍达5.72%准确率提升,优于现有方法。
  • 适合资源受限、需保护隐私的边缘智能部署场景。

随着移动与边缘计算的发展,边缘设备对低比特量化模型的需求日益增长,以实现高效部署。为提升性能,常需使用边缘数据对量化模型进行再训练。然而,出于隐私考虑,部分敏感数据只能在边缘设备本地处理。因此,在边缘设备上采用量化感知训练(QAT)成为有效方案。但传统QAT依赖完整数据集,计算成本高。核心集选择技术可通过训练代表性子集缓解此问题。现有方法在小规模数据集(如仅10%数据)下难以消除量化误差,导致性能显著下降。为此,我们提出QuaRC框架,结合核心集选择与级联层校正,在边缘设备上实现高效量化训练。在核心集选择阶段,引入相对熵评分识别最能反映模型量化误差的数据子集;在训练阶段,采用级联层校正策略,使量化模型中间层输出与全精度模型对齐,有效降低中间层量化误差。实验结果表明,当在ImageNet-1K上将ResNet-18量化至2比特,仅使用1%数据时,QuaRC相比先进方法实现5.72%的Top-1准确率提升。

原文摘要 · Abstract (English)

With the development of mobile and edge computing, the demand for low-bit quantized models on edge devices is increasing to achieve efficient deployment. To enhance the performance, it is often necessary to retrain the quantized models using edge data. However, due to privacy concerns, certain sensitive data can only be processed on edge devices. Therefore, employing Quantization-Aware Training (QAT) on edge devices has become an effective solution. Nevertheless, traditional QAT relies on the complete dataset for training, which incurs a huge computational cost. Coreset selection techniques can mitigate this issue by training on the most representative subsets. However, existing methods struggle to eliminate quantization errors in the model when using small-scale datasets (e.g., only 10% of the data), leading to significant performance degradation. To address these issues, we propose QuaRC, a QAT framework with coresets on edge devices, which consists of two main phases: In the coreset selection phase, QuaRC introduces the ``Relative Entropy Score" to identify the subsets that most effectively capture the model's quantization errors. During the training phase, QuaRC employs the Cascaded Layer Correction strategy to align the intermediate layer outputs of the quantized model with those of the full-precision model, thereby effectively reducing the quantization errors in the intermediate layers. Experimental results demonstrate the effectiveness of our approach. For instance, when quantizing ResNet-18 to 2-bit using a 1% data subset, QuaRC achieves a 5.72% improvement in Top-1 accuracy on the ImageNet-1K dataset compared to state-of-the-art techniques.

量化边缘计算核心集模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。