arXiv:2412.09899cs.LG2024-12被引 3

提出TTAQ方法,让低比特模型在动态数据中更稳定地保持精度。

TTAQ: Towards Stable Post-training Quantization in Continuous Domain Adaptation

  • 通过误差缓解和一致性重建,应对测试时域变化对量化器的干扰。
  • 2比特模型在ImageNet-C上错误率降低10.1%,显著提升稳定性。
  • 适合部署于数据持续变化的边缘设备场景,如自动驾驶、监控系统。

后训练量化(PTQ)通过在小校准集上将全精度模型压缩为低比特表示,无需重训练即可降低硬件开销。尽管近期进展显著,传统PTQ方法在动态多变的真实场景中仍易失效,尤其面临不可预测的数据流和持续域偏移。本文提出一种新的测试时自适应量化方法TTAQ,以应对动态测试域中传统PTQ的性能退化问题。TTAQ引入扰动误差缓解(PEM)与扰动一致性重建(PCR):PEM分析误差传播并设计权重正则化以减轻输入扰动影响;PCR采用一致性学习,确保同一样本在不同扰动下输出稳定。此外,提出自适应平衡损失(ABL),根据类别频率与复杂度调整logits,有效缓解数据流不确定性带来的类别不平衡问题。在多个数据集上与通用TTA方法对比实验表明,TTAQ显著优于现有基线,在不断变化的测试域中提升了低比特模型精度。例如,在ImageNet-C上,2比特模型的平均误差降低10.1%。

原文摘要 · Abstract (English)

Post-training quantization (PTQ) reduces excessive hardware cost by quantizing full-precision models into lower bit representations on a tiny calibration set, without retraining. Despite the remarkable progress made through recent efforts, traditional PTQ methods typically encounter failure in dynamic and ever-changing real-world scenarios, involving unpredictable data streams and continual domain shifts, which poses greater challenges. In this paper, we propose a novel and stable quantization process for test-time adaptation (TTA), dubbed TTAQ, to address the performance degradation of traditional PTQ in dynamically evolving test domains. To tackle domain shifts in quantizer, TTAQ proposes the Perturbation Error Mitigation (PEM) and Perturbation Consistency Reconstruction (PCR). Specifically, PEM analyzes the error propagation and devises a weight regularization scheme to mitigate the impact of input perturbations. On the other hand, PCR introduces consistency learning to ensure that quantized models provide stable predictions for same sample. Furthermore, we introduce Adaptive Balanced Loss (ABL) to adjust the logits by taking advantage of the frequency and complexity of the class, which can effectively address the class imbalance caused by unpredictable data streams during optimization. Extensive experiments are conducted on multiple datasets with generic TTA methods, proving that TTAQ can outperform existing baselines and encouragingly improve the accuracy of low bit PTQ models in continually changing test domains. For instance, TTAQ decreases the mean error of 2-bit models on ImageNet-C dataset by an impressive 10.1\%.

量化测试时适应稳定性低比特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。