解决隐私保护下客户端参与激励难题,提升联邦学习效率
JSAM: Privacy Straggler-Resilient Joint Client Selection and Incentive Mechanism Design in Differentially Private Federated Learning
- 联合优化选人概率与隐私补偿,动态筛选更愿意分享数据的用户
- 在预算限制下,测试准确率比现有方法最高提升15%
- 适合关注隐私安全与资源效率平衡的研究者
差分隐私联邦学习面临根本矛盾:保护隐私的机制会带来可量化的隐私成本,抑制客户端参与意愿,影响协同训练。现有激励机制依赖无偏选人,迫使服务器补偿最敏感的客户端(即‘隐私拖延者’),导致系统低效和资源错配。本文提出JSAM(联合客户端选择与隐私补偿机制),基于贝叶斯最优框架,同时优化选中概率与补偿策略,在预算约束下最大化训练效果。通过新理论揭示最优选人策略,将复杂的2N维优化简化为高效的三维问题。证明服务器应优先选择隐私容忍度高的用户,排除高敏感者;并发现隐私敏感度最低的用户可能因频繁参与而承担最高累积成本。在MNIST与CIFAR-10上的大量实验表明,相比无偏选人机制,JSAM在不同数据异构性条件下均实现最高15%的测试准确率提升,且保持成本效率。
原文摘要 · Abstract (English)
Differentially private federated learning faces a fundamental tension: privacy protection mechanisms that safeguard client data simultaneously create quantifiable privacy costs that discourage participation, undermining the collaborative training process. Existing incentive mechanisms rely on unbiased client selection, forcing servers to compensate even the most privacy-sensitive clients ("privacy stragglers"), leading to systemic inefficiency and suboptimal resource allocation. We introduce JSAM (Joint client Selection and privacy compensAtion Mechanism), a Bayesian-optimal framework that simultaneously optimizes client selection probabilities and privacy compensation to maximize training effectiveness under budget constraints. Our approach transforms a complex 2N-dimensional optimization problem into an efficient three-dimensional formulation through novel theoretical characterization of optimal selection strategies. We prove that servers should preferentially select privacy-tolerant clients while excluding high-sensitivity participants, and uncover the counter-intuitive insight that clients with minimal privacy sensitivity may incur the highest cumulative costs due to frequent participation. Extensive evaluations on MNIST and CIFAR-10 demonstrate that JSAM achieves up to 15% improvement in test accuracy compared to existing unbiased selection mechanisms while maintaining cost efficiency across varying data heterogeneity levels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。