arXiv:2512.23948cs.LGcs.CR2025-12

通过改进量化训练过程,提升量化CNN模型抗模型盗取攻击能力。

DivQAT: Enhancing Robustness of Quantized Convolutional Neural Networks against Model Extraction Attacks

  • 在量化训练中融入防御机制,而非事后添加噪声
  • 在多个视觉数据集上保持准确率同时抵御提取攻击
  • 适合部署在边缘设备的轻量级防御方案

卷积神经网络(CNN)及其量化版本易受模型提取攻击,存在知识产权被盗风险。然而,与大型模型相比,量化模型在该方面的鲁棒性研究较少。以往防御方法通常在训练后注入计算好的噪声,但此类方法未融入模型设计,且多数计算开销大,对受害模型的假设不切实际,难以应用于边缘设备及量化模型。本文提出DivQAT,一种基于量化感知训练(QAT)的新算法,旨在增强量化CNN对抗提取攻击的鲁棒性。据我们所知,这是首个将模型提取防御直接整合进量化过程的方案。在基准视觉数据集上的实证表明,该方法在不牺牲模型精度的前提下有效防御提取攻击。此外,将本量化技术与其他防御机制结合,可显著提升其效果,优于传统QAT。

原文摘要 · Abstract (English)

Convolutional Neural Networks (CNNs) and their quantized counterparts are vulnerable to extraction attacks, posing a significant threat of IP theft. Yet, the robustness of quantized models against these attacks is little studied compared to large models. Previous defenses propose to inject calculated noise into the prediction probabilities. However, these defenses are limited since they are not incorporated during the model design and are only added as an afterthought after training. Additionally, most defense techniques are computationally expensive and often have unrealistic assumptions about the victim model that are not feasible in edge device implementations and do not apply to quantized models. In this paper, we propose DivQAT, a novel algorithm to train quantized CNNs based on Quantization Aware Training (QAT) aiming to enhance their robustness against extraction attacks. To the best of our knowledge, our technique is the first to modify the quantization process to integrate a model extraction defense into the training process. Through empirical validation on benchmark vision datasets, we demonstrate the efficacy of our technique in defending against model extraction attacks without compromising model accuracy. Furthermore, combining our quantization technique with other defense mechanisms improves their effectiveness compared to traditional QAT.

量化模型安全防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。