arXiv:2510.02457cs.LG2025-10

发现动态量化可能导致模型性能骤降10%-65%,需警惕部署风险。

Assessing the Potential for Catastrophic Failure in Dynamic Post-Training Quantization

  • 用知识蒸馏与强化学习设计量化策略,评估最坏情况下的失败风险。
  • 实验显示部分组合导致准确率下降10%-65%,而稳健组合仅降2%以下。
  • 揭示了输入分布中易引发灾难性失效的脆弱点,适合安全关键场景研究者参考。

后训练量化(PTQ)通过降低权重和激活精度显著减少神经网络的计算复杂度和内存占用。然而,在推理过程中,输入分布的变化可能导致性能急剧下降。在安全关键场景部署时,必须评估这种潜在的性能退化及其成因。本文提出一种基于知识蒸馏与强化学习的方法,学习网络与位宽策略的配对,以分析动态PTQ下的最坏情况灾难性失效。实验验证了存在“有害”网络-策略组合,其准确率下降达10%-65%,而“鲁棒”组合仅下降不足2%。系统性实验还初步识别出高风险点。本工作为理解PTQ引入的失效案例提供起点,强调在实际部署中需加强鲁棒性评估与安全考量。

原文摘要 · Abstract (English)

Post-training quantization (PTQ) has recently emerged as an effective tool for reducing the computational complexity and memory usage of a neural network by representing its weights and activations with lower precision. While this paradigm has shown great success in lowering compute and storage costs, there is the potential for drastic performance reduction depending upon the distribution of inputs experienced in inference. When considering possible deployment in safety-critical environments, it is important to investigate the extent of potential performance reduction, and what characteristics of input distributions may give rise to this reduction. In this work, we explore the idea of extreme failure stemming from dynamic PTQ and formulate a knowledge distillation and reinforcement learning task to learn a network and bit-width policy pair such that catastrophic failure under quantization is analyzed in terms of worst case potential. Our results confirm the existence of this "detrimental" network-policy pair, with several instances demonstrating performance reductions in the range of 10-65% in accuracy, compared to their "robust" counterparts encountering a <2% decrease. From systematic experimentation and analyses, we also provide an initial exploration into points at highest vulnerability. While our results represent an initial step toward understanding failure cases introduced by PTQ, our findings ultimately emphasize the need for caution in real-world deployment scenarios. We hope this work encourages more rigorous examinations of robustness and a greater emphasis on safety considerations for future works within the broader field of deep learning.

量化鲁棒性安全评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。