arXiv:2602.22633cs.LGcs.DC2026-02

考虑隐私需求差异的联邦学习客户端选择方法

Tackling Privacy Heterogeneity in Differentially Private Federated Learning

  • 基于隐私预算差异设计自适应客户端选择策略
  • 在CIFAR-10上提升测试准确率最高达10%
  • 适合隐私要求各异的真实联邦学习场景

差分隐私联邦学习(DP-FL)使客户端在保护本地数据隐私的前提下协同训练模型。然而,现有方法通常假设所有客户端具有相同的隐私预算,这与现实场景中隐私需求差异巨大的情况不符。这种隐私异质性带来挑战:传统依赖数据量的客户端选择策略无法区分高质量更新与因严格隐私约束引入大量噪声的更新。为此,我们首次系统研究了DP-FL中的隐私感知客户端选择。通过推导收敛性分析,量化了隐私异质性对训练误差的影响。基于此,提出一个凸优化形式的隐私感知选择策略,可自适应调整选择概率以最小化训练误差。在基准数据集上的大量实验表明,该方法在异构隐私预算下,相较于现有基线在CIFAR-10上测试准确率最高提升10%。结果凸显了在客户端选择中考虑隐私异质性的必要性,以实现更实用高效的联邦学习。

原文摘要 · Abstract (English)

Differentially private federated learning (DP-FL) enables clients to collaboratively train machine learning models while preserving the privacy of their local data. However, most existing DP-FL approaches assume that all clients share a uniform privacy budget, an assumption that does not hold in real-world scenarios where privacy requirements vary widely. This privacy heterogeneity poses a significant challenge: conventional client selection strategies, which typically rely on data quantity, cannot distinguish between clients providing high-quality updates and those introducing substantial noise due to strict privacy constraints. To address this gap, we present the first systematic study of privacy-aware client selection in DP-FL. We establish a theoretical foundation by deriving a convergence analysis that quantifies the impact of privacy heterogeneity on training error. Building on this analysis, we propose a privacy-aware client selection strategy, formulated as a convex optimization problem, that adaptively adjusts selection probabilities to minimize training error. Extensive experiments on benchmark datasets demonstrate that our approach achieves up to a 10% improvement in test accuracy on CIFAR-10 compared to existing baselines under heterogeneous privacy budgets. These results highlight the importance of incorporating privacy heterogeneity into client selection for practical and effective federated learning.

联邦学习差分隐私客户端选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。