AloePri通过协同混淆实现大模型推理隐私保护,兼顾精度、效率与工业兼容性。
Towards Privacy-Preserving LLM Inference via Covariant Obfuscation (Technical Report)
- 采用协变混淆技术同步变换数据与模型参数,提升隐私性与准确性。
- 在6710亿参数模型上仅造成0~3.5%精度损失,性能接近明文推理。
- 可部署于异构硬件集群,适合实际工业系统使用。
大型语言模型的快速发展推动了云端推理服务的广泛应用,但也带来了远程推理中私有数据传输与处理的显著隐私风险。为使隐私保护的LLM推理技术在工业场景中落地,需同时满足三大核心要求:(1) 尽量减少精度与效率损失以保障服务体验;(2) 支持由异构旧式xPU组成的规模化集群运行;(3) 兼容现有LLM基础设施,复用其工程优化。据我们所知,目前尚无方法能同时满足上述条件并提供有效隐私保障。本文提出AloePri,首个面向工业应用的隐私保护LLM推理方案。AloePri通过协变混淆技术保护输入与输出数据,联合变换数据与模型参数,在保证推理精度与数据隐私的同时,完全兼容现有语言模型即服务(LLMaaS)基础设施。AloePri已集成至工业系统中,对主流模型进行评估。在Deepseek-V3.1-Terminus(671B参数)上的测试表明,AloePri导致的精度损失为0.0%~3.5%,效率等同于明文推理,且能有效抵御先进攻击,恢复的令牌比例低于5%。据我们所知,AloePri是首个在真实系统中实现大规模模型实用化的隐私保护推理方法。
原文摘要 · Abstract (English)
The rapid development of large language models (LLMs) has driven the widespread adoption of cloud-based LLM inference services, while also bringing prominent privacy risks associated with the transmission and processing of private data in remote inference. For privacy-preserving LLM inference technologies to be practically applied in industrial scenarios, three core requirements must be satisfied simultaneously: (1) Accuracy and efficiency losses should be minimized to mitigate degradation in service experience. (2) The inference process can be run on large-scale clusters consist of heterogeneous legacy xPUs. (3) Compatibility with existing LLM infrastructures should be ensured to reuse their engineering optimizations. To the best of our knowledge, none of the existing privacy-preserving LLM inference methods satisfy all the above constraints while delivering meaningful privacy guarantees. In this paper, we propose AloePri, the first privacy-preserving LLM inference method for industrial applications. AloePri protects both the input and output data by covariant obfuscation, which jointly transforms data and model parameters to achieve better accuracy and privacy. We carefully design the transformation for each model component to ensure inference accuracy and data privacy while keeping full compatibility with existing infrastructures of Language Model as a Service. AloePri has been integrated into an industrial system for the evaluation of mainstream LLMs. The evaluation on Deepseek-V3.1-Terminus model (671B parameters) demonstrates that AloePri causes accuracy loss of 0.0%~3.5% and exhibits efficiency equivalent to that of plaintext inference. Meanwhile, AloePri successfully resists state-of-the-art attacks, with less than 5\% of tokens recovered. To the best of our knowledge, AloePri is the first method to exhibit practical applicability to large-scale models in real-world systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。