arXiv:2412.10652cs.LGcs.CR2024-12ACL被引 12

CENTAUR用随机置换+安全计算,实现隐私、效率、性能三者兼得。

CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference

  • 结合随机置换与安全多方计算,针对Transformer结构设计专用算法。
  • 推理速度提升5.0至30.4倍,精度接近明文水平,抵抗数据重构攻击。
  • 适合需要高隐私保护又追求高效推理的云上AI部署场景。

随着预训练模型(如Transformer)在云平台上的广泛应用,模型参数和推理数据的隐私问题日益突出。现有的隐私保护Transformer推理(PPTI)框架面临隐私、效率与性能难以兼顾的‘不可能三角’:基于安全多方计算(SMPC)的方法虽能保证强隐私性,但计算开销大、性能损失严重;而基于置换的方法虽接近明文效率与准确率,却会暴露敏感的模型参数和中间结果。为破解这一难题,本文提出CENTAUR——一个创新的PPTI框架,通过巧妙融合随机置换与SMPC,实现三者均衡。针对Transformer的结构特性,设计了高效的隐私保护推理算法,实验表明,CENTAUR可有效抵御多种数据重构攻击,达到明文级别的推理准确率,并使推理速度提升5.0至30.4倍,为安全高效的AI部署开辟新可能。

原文摘要 · Abstract (English)

With the growing deployment of pre-trained models like Transformers on cloud platforms, privacy concerns about model parameters and inference data are intensifying. Existing Privacy-Preserving Transformer Inference (PPTI) frameworks face the "impossible trinity" of balancing privacy, efficiency, and performance: Secure Multi-Party Computation (SMPC)-based approaches ensure strong privacy but suffer from high computational overhead and performance losses; Conversely, permutation-based methods achieve near-plaintext efficiency and accuracy but compromise privacy by exposing sensitive model parameters and intermediate results. Bridging this gap with a single approach presents substantial challenges, motivating the introduction of CENTAUR, a groundbreaking PPTI framework that seamlessly integrates random permutations and SMPC to address the "impossible trinity". By designing efficient PPTI algorithms tailored to the structural properties of Transformer models, CENTAUR achieves an unprecedented balance among privacy, efficiency, and performance. Our experiments demonstrate CENTAUR's ability to resist diverse data reconstruction attacks, achieve plaintext-level inference accuracy, and boost inference speed by 5.0-30.4 times, unlocking new possibilities for secure and efficient AI deployment.

隐私计算Transformer安全推理高效加密

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。