解决跨组织联邦学习中的搭便车与利益冲突问题,确保合作双赢。
Free-Rider and Conflict Aware Collaboration Formation for Cross-Silo Federated Learning
- 基于利益一致性分组,构建无竞争的联盟合作结构。
- 实验显示优于9种主流方法,在多个基准数据集上提升模型性能。
- 适合有竞争关系的企业间协作场景,保障各方收益与数据隐私。
联邦学习(FL)允许多个参与方在不共享私有数据的前提下协同训练模型。由于数据异构性,训练过程中可能出现负迁移。因此需根据数据互补性选择参与方。在跨组织联邦学习中,从事商业活动的组织是主要参与方,其形成的生态系统具有自利性和参与者间的竞争性,要求参与方选择策略同时缓解搭便车和利益冲突问题。为此,我们提出最优协作形成策略 FedEgoists,确保:(1) 参与方仅在对整个生态有益时才能获益;(2) 参与方不会向竞争对手或其支持者贡献资源。该方法提供高效聚类方案,将参与方分组为利益一致的联盟。理论证明所形成的联盟最优,即任何联盟联合都无法提升其成员效用。在广泛采用的基准数据集上的大量实验表明,相比九种先进基线方法,FedEgoists 具有显著优势,并能在存在商业竞争关系的跨组织联邦学习中建立高效的协作网络。
原文摘要 · Abstract (English)
Federated learning (FL) is a machine learning paradigm that allows multiple FL participants (FL-PTs) to collaborate on training models without sharing private data. Due to data heterogeneity, negative transfer may occur in the FL training process. This necessitates FL-PT selection based on their data complementarity. In cross-silo FL, organizations that engage in business activities are key sources of FL-PTs. The resulting FL ecosystem has two features: (i) self-interest, and (ii) competition among FL-PTs. This requires the desirable FL-PT selection strategy to simultaneously mitigate the problems of free riders and conflicts of interest among competitors. To this end, we propose an optimal FL collaboration formation strategy -- FedEgoists -- which ensures that: (1) a FL-PT can benefit from FL if and only if it benefits the FL ecosystem, and (2) a FL-PT will not contribute to its competitors or their supporters. It provides an efficient clustering solution to group FL-PTs into coalitions, ensuring that within each coalition, FL-PTs share the same interest. We theoretically prove that the FL-PT coalitions formed are optimal since no coalitions can collaborate together to improve the utility of any of their members. Extensive experiments on widely adopted benchmark datasets demonstrate the effectiveness of FedEgoists compared to nine state-of-the-art baseline methods, and its ability to establish efficient collaborative networks in cross-silos FL with FL-PTs that engage in business activities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。