研究激励与切片层选择如何影响联邦学习中数据贡献。
How Can Incentives and Cut Layer Selection Influence Data Contribution in Split Federated Learning?
- 用斯塔克尔伯格博弈建模主从决策,优化激励与切片层。
- 均衡解使客户端与模型方收益最大化。
- 兼顾隐私保护与能耗,适合分布式学习系统设计者。
为缓解联邦学习中的训练负担并提升收敛速度,分层联邦学习(SFL)结合了联邦学习与分层学习的优势,成为一种有前景的方法。然而,现有研究大多忽视了竞争场景。在该框架中,模型所有者可选择切片层以平衡服务器与客户端的训练负载,同时保障客户端的数据隐私。此外,模型所有者设定激励机制以促进客户端参与。模型所有者的优化策略会影响客户端在考虑共享激励与预期能耗下的数据贡献量。为此,我们采用分层决策方法建模,将其表述为单领导者多追随者的斯塔克尔伯格博弈。我们证明了客户端纳什均衡的存在性与唯一性,并通过分析领导者博弈来研究斯塔克尔伯格均衡。此外,我们讨论了差分隐私相关的隐私问题及最小必要切片层的选择标准。研究结果表明,斯塔克尔伯格均衡解能最大化客户端与模型所有者的效用。
原文摘要 · Abstract (English)
To alleviate the training burden in federated learning while enhancing convergence speed, Split Federated Learning (SFL) has emerged as a promising approach by combining the advantages of federated and split learning. However, recent studies have largely overlooked competitive situations. In this framework, the SFL model owner can choose the cut layer to balance the training load between the server and clients, ensuring the necessary level of privacy for the clients. Additionally, the SFL model owner sets incentives to encourage client participation in the SFL process. The optimization strategies employed by the SFL model owner influence clients' decisions regarding the amount of data they contribute, taking into account the shared incentives over clients and anticipated energy consumption during SFL. To address this framework, we model the problem using a hierarchical decision-making approach, formulated as a single-leader multi-follower Stackelberg game. We demonstrate the existence and uniqueness of the Nash equilibrium among clients and analyze the Stackelberg equilibrium by examining the leader's game. Furthermore, we discuss privacy concerns related to differential privacy and the criteria for selecting the minimum required cut layer. Our findings show that the Stackelberg equilibrium solution maximizes the utility for both the clients and the SFL model owner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。