arXiv:2604.23426cs.CVcs.LG2026-04被引 5

通过自适应量化与差分隐私提升非独立同分布联邦学习的通信效率与隐私保护。

Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy

论文配图:Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy
图 1 · 摘自论文原文
  • 结合拉普拉斯差分隐私与动态比特调度,实现隐私与通信优化平衡。
  • 在多个数据集上减少52.64%通信数据量,同时保持模型精度与强隐私保障。
  • 适合关注联邦学习中隐私安全与低带宽部署的研究者与工程师。

联邦学习(FL)是一种分布式机器学习方法,多个设备在中央服务器管理下协作训练模型,而不共享原始数据。其主要挑战之一是设备间连接速度和带宽差异导致的通信瓶颈。因此,降低训练过程中传输数据的大小至关重要。此外,训练过程中的模型或梯度分析可能暴露敏感信息。为同时解决隐私与通信效率问题,本文结合差分隐私(DP)与自适应量化方法。采用基于拉普拉斯的差分隐私,该方法在联邦学习中相对较少被研究,但比高斯型差分隐私提供更紧致的隐私保证。提出一种基于轮次余弦退火的全局比特长度调度器,以及一种基于客户端贡献估计(通过数据集熵分析)的动态自适应调度器。在CIFAR10、MNIST和医学影像数据集上进行了大量实验,使用不同客户端数量、比特调度策略和隐私预算下的非独立同分布数据分布。结果表明,所提自适应量化方法在保持竞争性模型精度的同时,相比32位浮点训练,使总通信数据量减少最多达52.64%(MNIST)、45.06%(CIFAR10),以及医疗影像数据集的31%至37%。所有实验均确保了通过差分隐私实现的鲁棒隐私保护。

原文摘要 · Abstract (English)

Federated learning (FL) is a distributed machine learning method where multiple devices collaboratively train a model under the management of a central server without sharing underlying data. One of the key challenges of FL is the communication bottleneck caused by variations in connection speed and bandwidth across devices. Therefore, it is essential to reduce the size of transmitted data during training. Additionally, there is a potential risk of exposing sensitive information through the model or gradient analysis during training. To address both privacy and communication efficiency, we combine differential privacy (DP) and adaptive quantization methods. We use Laplacian-based DP to preserve privacy, which is relatively underexplored in FL and offers tighter privacy guarantees than Gaussian-based DP. We propose a simple and efficient global bit-length scheduler using round-based cosine annealing, along with a client-based scheduler that dynamically adapts based on client contribution estimated through dataset entropy analysis. We evaluate our approach through extensive experiments on CIFAR10, MNIST, and medical imaging datasets, using non-IID data distributions across varying client counts, bit-length schedulers, and privacy budgets. The results show that our adaptive quantization methods reduce total communicated data by up to 52.64% for MNIST, 45.06% for CIFAR10, and 31% to 37% for medical imaging datasets compared to 32-bit float training while maintaining competitive model accuracy and ensuring robust privacy through differential privacy.

联邦学习差分隐私通信压缩自适应量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。