让加密推理更快更省,实现云端隐私保护的机器学习服务
Design and Optimization of Cloud Native Homomorphic Encryption Workflows for Privacy-Preserving ML Inference
- 用容器+K8s搭建可弹性扩展的加密推理架构
- 优化后推理速度提升3.2倍,内存占用降低40%
- 适合需要数据保密的云上模型服务场景
随着机器学习模型越来越多地通过云基础设施部署,推理过程中用户数据的机密性成为重大安全挑战。同态加密(HE)作为一种允许在加密数据上进行计算的密码技术,可实现不解密敏感输入即可生成预测。然而,将HE集成到大规模云原生流水线仍受限于高计算开销、编排复杂性和模型兼容性问题。本文提出一种系统化的云原生同态加密工作流设计与优化框架,支持隐私保护的机器学习推理。该架构将容器化的HE模块与基于Kubernetes的编排相结合,实现分布式环境下的弹性伸缩与并行加密计算。此外,通过密文打包、多项式模数调整和算子融合等优化策略,在保持密码学完整性的前提下显著降低延迟与资源消耗。实验结果表明,所提系统相比传统HE流水线,推理加速最高达3.2倍,内存利用率降低40%。这些成果为在零信任云环境下部署安全的机器学习即服务(MLaaS)系统提供了可行路径。
原文摘要 · Abstract (English)
As machine learning (ML) models become increasingly deployed through cloud infrastructures, the confidentiality of user data during inference poses a significant security challenge. Homomorphic Encryption (HE) has emerged as a compelling cryptographic technique that enables computation on encrypted data, allowing predictions to be generated without decrypting sensitive inputs. However, the integration of HE within large scale cloud native pipelines remains constrained by high computational overhead, orchestration complexity, and model compatibility issues. This paper presents a systematic framework for the design and optimization of cloud native homomorphic encryption workflows that support privacy-preserving ML inference. The proposed architecture integrates containerized HE modules with Kubernetes-based orchestration, enabling elastic scaling and parallel encrypted computation across distributed environments. Furthermore, optimization strategies including ciphertext packing, polynomial modulus adjustment, and operator fusion are employed to minimize latency and resource consumption while preserving cryptographic integrity. Experimental results demonstrate that the proposed system achieves up to 3.2times inference acceleration and 40% reduction in memory utilization compared to conventional HE pipelines. These findings illustrate a practical pathway for deploying secure ML-as-a-Service (MLaaS) systems that guarantee data confidentiality under zero-trust cloud conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。