让数据提供方自愿贡献数据并准确学习模型参数。
Incentivize Contribution and Learn Parameters Too: Federated Learning with Strategic Data Owners
- 设计机制使客户端在纳什均衡下主动参与联邦学习。
- 实验显示算法收敛快,所有参与者模型性能更好。
- 适合关注激励机制与实际部署的系统研究者。
传统联邦学习假设客户端自愿提供少量噪声数据,以分布式方式协作训练更精准的全局模型,但未考虑数据收集和运行算法对客户端的成本。本文解决同时学习模型参数与激励客户端真实贡献的问题。第一个机制确保客户端在纳什均衡下参与,并在中间阶段诚实披露信息;第二个机制实现全量数据贡献与最优参数学习。在真实联邦数据集(CIFAR-10、FEMNIST、Twitter)上的大规模实验表明,算法收敛迅速,具备良好福利保障,且所有客户端模型表现更优。
原文摘要 · Abstract (English)
Classical federated learning (FL) assumes that the clients have a limited amount of noisy data with which they voluntarily participate and contribute towards learning a global, more accurate model in a principled manner. The learning happens in a distributed fashion without sharing the data with the center. However, these methods do not consider the incentive of an agent for participating and contributing to the process, given that data collection and running a distributed algorithm is costly for the clients. The question of rationality of contribution has been asked recently in the literature and some results exist that consider this problem. This paper addresses the question of simultaneous parameter learning and incentivizing contribution in a truthful manner, which distinguishes it from the extant literature. Our first mechanism incentivizes each client to contribute to the FL process at a Nash equilibrium and simultaneously learn the model parameters. We also ensure that agents are incentivized to truthfully reveal information in the intermediate stages of the algorithm. However, this equilibrium outcome can be away from the optimal, where clients contribute with their full data and the algorithm learns the optimal parameters. We propose a second mechanism that enables the full data contribution along with optimal parameter learning. Large scale experiments with real (federated) datasets (CIFAR-10, FEMNIST, and Twitter) show that these algorithms converge quite fast in practice, yield good welfare guarantees and better model performance for all agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。