arXiv:2510.21086cs.LGcs.CR2025-10NeurIPS被引 3

用轻量加密保护联邦学习梯度,速度接近明文训练。

DictPFL: Efficient and Private Federated Learning on Encrypted Gradients

  • 将模型参数分为静态字典和可更新表,仅加密传输部分
  • 通过历史引导的剪枝减少加密参数量,通信开销降低748倍
  • 在保证全隐私前提下,训练速度比全加密快65倍,接近明文

联邦学习(FL)可在不共享原始数据的情况下实现跨机构协作训练,但梯度共享仍存在隐私泄露风险,如梯度反演攻击。同态加密(HE)虽能保障聚合安全,但常带来巨大计算与通信开销。现有基于HE的FL方法面临两难:全梯度加密保障隐私但代价高昂,部分加密则存在漏洞。本文提出DictPFL框架,在最小开销下实现完整梯度保护。该方法加密所有传输梯度,同时保持未传输参数本地化,不增加计算负担。其核心包括两个模块:DePE将模型权重分解为静态字典与可更新查找表,仅后者加密并聚合,静态字典本地保留,无需共享或加密;PrME采用加密感知剪枝,通过一致的历史引导掩码最小化需加密参数。实验表明,相比全加密FL,DictPFL通信成本降低402–748倍,训练加速28–65倍,且在开销上优于现有选择性加密方法51–155倍,速度提升4–19倍。尤为关键的是,其运行时间仅为明文FL的2倍以内,首次证明基于HE的私有联邦学习具备真实部署可行性。代码已公开于https://github.com/UCF-ML-Research/DictPFL。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across institutions without sharing raw data. However, gradient sharing still risks privacy leakage, such as gradient inversion attacks. Homomorphic Encryption (HE) can secure aggregation but often incurs prohibitive computational and communication overhead. Existing HE-based FL methods sit at two extremes: encrypting all gradients for full privacy at high cost, or partially encrypting gradients to save resources while exposing vulnerabilities. We present DictPFL, a practical framework that achieves full gradient protection with minimal overhead. DictPFL encrypts every transmitted gradient while keeping non-transmitted parameters local, preserving privacy without heavy computation. It introduces two key modules: Decompose-for-Partial-Encrypt (DePE), which decomposes model weights into a static dictionary and an updatable lookup table, only the latter is encrypted and aggregated, while the static dictionary remains local and requires neither sharing nor encryption; and Prune-for-Minimum-Encrypt (PrME), which applies encryption-aware pruning to minimize encrypted parameters via consistent, history-guided masks. Experiments show that DictPFL reduces communication cost by 402-748$\times$ and accelerates training by 28-65$\times$ compared to fully encrypted FL, while outperforming state-of-the-art selective encryption methods by 51-155$\times$ in overhead and 4-19$\times$ in speed. Remarkably, DictPFL's runtime is within 2$\times$ of plaintext FL, demonstrating for the first time, that HE-based private federated learning is practical for real-world deployment. The code is publicly available at https://github.com/UCF-ML-Research/DictPFL.

联邦学习同态加密隐私保护高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。