arXiv:2502.01013cs.CRcs.AI2025-02被引 4

提出等变加密技术,实现大模型推理零性能损耗的隐私保护。

Encrypted Large Model Inference: The Equivariant Encryption Paradigm

  • 仅对神经网络关键内部表示加密,不改变线性与部分非线性操作
  • 在去中心化场景下保持高吞吐和输出精度,无显著延迟
  • 适合对安全与效率要求高的大模型部署场景

大规模深度学习模型(如现代语言模型和扩散架构)已革新自然语言处理与计算机视觉等领域。然而,在分布式或去中心化环境中部署时,推理过程可能暴露敏感数据,引发隐私风险。传统方法如安全多方计算、同态加密和差分隐私虽有一定缓解作用,但常伴随巨大计算开销、延迟或对非线性操作兼容性差的问题。本文提出等变加密(Equivariant Encryption, EE),一种新范式,可在几乎零性能开销下实现对加密数据的“盲”推理。不同于全图同态加密,EE仅选择性混淆神经网络层中的关键内部表示,同时保留线性及指定非线性操作的精确功能。该机制确保输入、中间激活和输出全程保密,即使在不可信基础设施上处理亦然。我们阐述了EE的理论基础,对比其性能与集成复杂度,验证其在卷积网络到大语言模型等多种架构中的适用性。此外,提供全面威胁分析,列举潜在攻击向量与应对策略,并在去中心化环境下基准测试其表现。结果表明,EE在保持高保真度与吞吐率的同时,有效弥合了强数据保密性与现代大模型推理严苛效率需求之间的差距。

原文摘要 · Abstract (English)

Large scale deep learning model, such as modern language models and diffusion architectures, have revolutionized applications ranging from natural language processing to computer vision. However, their deployment in distributed or decentralized environments raises significant privacy concerns, as sensitive data may be exposed during inference. Traditional techniques like secure multi-party computation, homomorphic encryption, and differential privacy offer partial remedies but often incur substantial computational overhead, latency penalties, or limited compatibility with non-linear network operations. In this work, we introduce Equivariant Encryption (EE), a novel paradigm designed to enable secure, "blind" inference on encrypted data with near zero performance overhead. Unlike fully homomorphic approaches that encrypt the entire computational graph, EE selectively obfuscates critical internal representations within neural network layers while preserving the exact functionality of both linear and a prescribed set of non-linear operations. This targeted encryption ensures that raw inputs, intermediate activations, and outputs remain confidential, even when processed on untrusted infrastructure. We detail the theoretical foundations of EE, compare its performance and integration complexity against conventional privacy preserving techniques, and demonstrate its applicability across a range of architectures, from convolutional networks to large language models. Furthermore, our work provides a comprehensive threat analysis, outlining potential attack vectors and baseline strategies, and benchmarks EE against standard inference pipelines in decentralized settings. The results confirm that EE maintains high fidelity and throughput, effectively bridging the gap between robust data confidentiality and the stringent efficiency requirements of modern, large scale model inference.

大模型安全加密推理隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。