arXiv:2412.08534cs.DCcs.CR2024-12被引 2

保护数据、模型和代码的机密性与用户隐私,支持安全协作训练。

Protecting Confidentiality, Privacy and Integrity in Collaborative Learning

  • 利用虚拟机级可信执行环境与操作系统级沙箱技术保护资产机密性。
  • 增强差分隐私机制,在保障模型性能前提下保护用户数据隐私。
  • 可抵御恶意模型攻击,适合对隐私与安全要求高的协作场景。

数据所有者与模型所有者之间的协作对于高效机器学习训练至关重要。然而,在协作过程中,双方均需保护各自资产的机密性(即数据集、模型和训练代码),其中数据所有者还关心其数据集中个体用户的隐私。现有方案或仅提供有限的模型与代码保密性,或因合谋问题导致隐私泄露。本文提出Citadel++,一种协同机器学习训练系统,可同时保护数据、模型、训练代码的机密性以及个体用户的数据隐私。通过增强差分隐私机制,在保持模型效用的同时保护用户隐私;结合虚拟机级可信执行环境(TEEs)及改进的沙箱与完整性机制,有效保障数据、模型和代码的机密性,并在模型与代码被恶意设计的情况下仍能强制执行隐私策略。实验表明,Citadel++在满足数据与模型所有者保密与隐私要求的前提下,保持了良好模型性能,其在CPU TEE上比最先进系统快543倍,在GPU TEE上快113倍。

原文摘要 · Abstract (English)

A collaboration between dataset owners and model owners is needed to facilitate effective machine learning (ML) training. During this collaboration, however, dataset owners and model owners want to protect the confidentiality of their respective assets (i.e., datasets, models and training code), with the dataset owners also caring about the privacy of individual users whose data is in their datasets. Existing solutions either provide limited confidentiality for models and training code, or suffer from privacy issues due to collusion. We present Citadel++, a collaborative ML training system designed to simultaneously protect the confidentiality of datasets, models and training code as well as the privacy of individual users. Citadel++ enhances differential privacy mechanisms to safeguard the privacy of individual user data while maintaining model utility. By employing Virtual Machine-level Trusted Execution Environments (TEEs) as well as the improved sandboxing and integrity mechanisms through OS-level techniques, Citadel++ effectively preserves the confidentiality of datasets, models and training code, and enforces our privacy mechanisms even when the models and training code have been maliciously designed. Our experiments show that Citadel++ provides model utility and performance while adhering to the confidentiality and privacy requirements of dataset owners and model owners, outperforming the state-of-the-art privacy-preserving training systems by up to 543x on CPU and 113x on GPU TEEs.

隐私保护可信计算差分隐私协同训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。