通过训练让神经元权重趋同,有效防御参数窃取攻击。
Train to Defend: First Defense Against Cryptanalytic Neural Network Parameter Extraction Attacks
- 在标准损失上添加正则项,使同一层神经元权重趋于一致。
- 防御后模型准确率下降不足1%,且推理无额外开销。
- 首次提供理论框架评估攻击成功率,适合高价值模型防护。
神经网络因其训练成本高、依赖专家经验与专有数据,是重要的知识产权。保护其参数不仅关乎竞争优势,也影响安全与隐私。已有研究显示,密码分析攻击已能成功应用于更深模型。本文提出首个针对此类参数提取攻击的防御机制。核心思想是消除攻击所依赖的神经元唯一性,通过一种新型的、面向提取的训练方法实现:在标准损失函数中加入正则项,最小化层内神经元权重间的距离。该防御在推理阶段无面积-延迟开销。我们在多种架构与数据集上评估了防御效果,结果表明,在相同架构下,使用改进损失函数训练后,模型准确率变化小于1%。此外,我们构建了理论框架以量化攻击成功率。在多项先前攻击设置下,防御模型能持续抵御提取攻击,而未受保护的模型仅需14分钟至4小时即被攻破。
原文摘要 · Abstract (English)
Neural networks are valuable intellectual property due to the significant computational cost, expert labor, and proprietary data involved in their development. Consequently, protecting their parameters is critical not only for maintaining a competitive advantage but also for enhancing the model's security and privacy. Prior works have demonstrated the growing capability of cryptanalytic attacks to scale to deeper models. In this paper, we present the first defense mechanism against cryptanalytic parameter extraction attacks. Our key insight is to eliminate the neuron uniqueness necessary for these attacks to succeed. We achieve this by a novel, extraction-aware training method. Specifically, we augment the standard loss function with an additional regularization term that minimizes the distance between neuron weights within a layer. Therefore, the proposed defense has zero area-delay overhead during inference. We evaluate the effectiveness of our approach in mitigating extraction attacks while analyzing the model accuracy across different architectures and datasets. When re-trained with the same model architecture, the results show that our defense incurs a marginal accuracy change of less than 1% with the modified loss function. Moreover, we present a theoretical framework to quantify the success probability of the attack. When tested comprehensively with prior attack settings, our defense demonstrated empirical success for sustained periods of extraction, whereas unprotected networks are extracted between 14 minutes to 4 hours.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。