用博弈论优化联邦学习,让各客户端公平贡献且不拖慢整体进度。
Incentive-Compatible Federated Learning with Stackelberg Game Modeling
- 服务器作为主导方动态调整奖励因子,客户端根据自身条件自主选择训练轮数。
- 在非独立同分布数据下,准确率分布更均匀,整体性能与收敛速度不变。
- 适合资源差异大的真实场景,尤其关注公平性的系统设计者可参考。
联邦学习(FL)作为一种去中心化机器学习范式,使客户端在保护数据隐私的同时协同训练全局模型。然而,在异构环境下,客户端资源与能力差异会严重影响系统性能。现有方法多聚焦于提升全局模型精度,常导致客户端间不公平及系统效率低下,尤其在非独立同分布(non-IID)设置下。本文提出FLamma,一种基于自适应伽马参数的斯塔克尔伯格博弈框架,旨在解决上述问题并促进公平性。服务器作为领导者,动态调整衰减因子;客户端作为追随者,优化本地训练轮数以最大化自身效用。随着时间推移,服务器逐步平衡客户端影响:初期奖励高贡献者,随后逐步降低其权重,推动系统趋向斯塔克尔伯格均衡。在IID与non-IID数据集上的大量仿真表明,该方法显著改善了准确率分布的公平性,同时保持整体模型性能与收敛速度,优于传统联邦学习基线。
原文摘要 · Abstract (English)
Federated Learning (FL) has gained prominence as a decentralized machine learning paradigm, allowing clients to collaboratively train a global model while preserving data privacy. Despite its potential, FL faces significant challenges in heterogeneous environments, where varying client resources and capabilities can undermine overall system performance. Existing approaches primarily focus on maximizing global model accuracy, often at the expense of unfairness among clients and suboptimal system efficiency, particularly in non-IID (non-Independent and Identically Distributed) settings. In this paper, we introduce FLamma, a novel Federated Learning framework based on adaptive gamma-based Stackelberg game, designed to address the aforementioned limitations and promote fairness. Our approach allows the server to act as the leader, dynamically adjusting a decay factor while clients, acting as followers, optimally select their number of local epochs to maximize their utility. Over time, the server incrementally balances client influence, initially rewarding higher-contributing clients and gradually leveling their impact, driving the system toward a Stackelberg Equilibrium. Extensive simulations on both IID and non-IID datasets show that our method significantly improves fairness in accuracy distribution without compromising overall model performance or convergence speed, outperforming traditional FL baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。