arXiv:2505.19823cs.LGcs.AI2025-05

动态分配隐私预算,提升异构环境下的联邦学习隐私与效率

LAPA-based Dynamic Privacy Optimization for Wireless Federated Learning in Heterogeneous Environments

  • 根据设备数据差异动态分配隐私预算,不传额外信息
  • 结合通信噪声优化噪声强度,收敛速度提升23.6%
  • 适合资源受限的异构无线联邦学习场景

联邦学习(FL)通过分布式训练保护设备数据隐私,但仍可能因梯度泄露攻击被破解。差分隐私(DP)通过向梯度添加人工噪声降低泄露风险,但会损害模型性能,尤其在非独立同分布(Non-IID)数据下更为显著。针对数据异构对聚合性能的影响,本文提出轻量级自适应隐私分配(LAPA)策略,在每轮聚合中为设备分配个性化隐私预算,仅传输梯度,无需额外信息,兼顾隐私与聚合效率。进一步采用深度确定性策略梯度(DDPG)算法优化传输功率,使自适应衰减的人工噪声与通信噪声对齐,实现DP与系统效用的有效平衡。同时设计融合通信质量与数据分布特征的可靠聚合策略,提升聚合性能并保障隐私。实验表明,所提LAPA方法在满足隐私要求的同时,显著提升收敛性能,相比基线平均加速23.6%。

原文摘要 · Abstract (English)

Federated Learning (FL) is a distributed machine learning paradigm based on protecting data privacy of devices, which however, can still be broken by gradient leakage attack via parameter inversion techniques. Differential privacy (DP) technology reduces the risk of private data leakage by adding artificial noise to the gradients, but detrimental to the FL utility at the same time, especially in the scenario where the data is Non-Independent Identically Distributed (Non-IID). Based on the impact of heterogeneous data on aggregation performance, this paper proposes a Lightweight Adaptive Privacy Allocation (LAPA) strategy, which assigns personalized privacy budgets to devices in each aggregation round without transmitting any additional information beyond gradients, ensuring both privacy protection and aggregation efficiency. Furthermore, the Deep Deterministic Policy Gradient (DDPG) algorithm is employed to optimize the transmission power, in order to determine the optimal timing at which the adaptively attenuated artificial noise aligns with the communication noise, enabling an effective balance between DP and system utility. Finally, a reliable aggregation strategy is designed by integrating communication quality and data distribution characteristics, which improves aggregation performance while preserving privacy. Experimental results demonstrate that the personalized noise allocation and dynamic optimization strategy based on LAPA proposed in this paper enhances convergence performance while satisfying the privacy requirements of FL.

联邦学习差分隐私动态优化异构环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。