arXiv:2411.09945cs.CRcs.AI2024-11中稿 · TOSEM被引 23

提出新方法在可信环境保护敏感模型,对抗已知攻击者且提速10倍。

TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models

  • 训练前分片:将敏感权重与模型其他部分分离,增强安全性。
  • 计算成本降低10倍,同时实现全模型防护。
  • 适用于CNN和大语言模型,可压缩私有功能为轻量切片。

可信执行环境(TEE)用于保护设备端的神经网络模型。然而,直接使用TEE保护整个DNN模型面临计算速度受限的问题。虽然使用GPU可加速计算,但商用主流GPU通常缺乏安全保护。为此,学者提出TSDP方法,在TEE中保护隐私敏感权重,并将不敏感权重卸载至GPU。然而,现有方法未考虑具备大量公开预训练模型和数据集的知情攻击者。本文研究了现有方法在该攻击场景下的安全性,发现其无法实现承诺的保护效果。为此,我们提出一种训练前分片策略,有效分离敏感权重与其他模型组件。评估表明,该方法可在计算成本降低10倍的前提下提供完整模型保护。此外,我们在传统CNN模型外,还验证了其在大型语言模型上的可扩展性:能将大语言模型的私有功能压缩为轻量切片,达到与整体屏蔽基线相同的安全水平。

原文摘要 · Abstract (English)

Trusted Execution Environments (TEE) are used to safeguard on-device models. However, directly employing TEEs to secure the entire DNN model is challenging due to the limited computational speed. Utilizing GPU can accelerate DNN's computation speed but commercial widely-available GPUs usually lack security protection. To this end, scholars introduce TSDP, a method that protects privacy-sensitive weights within TEEs and offloads insensitive weights to GPUs. Nevertheless, current methods do not consider the presence of a knowledgeable adversary who can access abundant publicly available pre-trained models and datasets. This paper investigates the security of existing methods against such a knowledgeable adversary and reveals their inability to fulfill their security promises. Consequently, we introduce a novel partition before training strategy, which effectively separates privacy-sensitive weights from other components of the model. Our evaluation demonstrates that our approach can offer full model protection with a computational cost reduced by a factor of 10. In addition to traditional CNN models, we also demonstrate the scalability to large language models. Our approach can compress the private functionalities of the large language model to lightweight slices and achieve the same level of protection as the shielding-whole-model baseline.

模型保护可信环境大模型安全分片策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。