提出DPVS-Shapley,让联邦学习贡献评估更快更准
DPVS-Shapley:Faster and Universal Contribution Evaluation Component in Federated Learning
- 动态裁剪验证集,加速贡献计算过程
- 可为难样本分配更高权重,提升评估精度
- 适合需要高效公平激励的联邦学习系统
在人工智能时代,联邦学习作为一种新型去中心化学习范式,有效缓解了集中式学习的数据隐私风险,并提升了系统的可扩展性与鲁棒性。然而,如何公平准确地评估各参与方的贡献成为新挑战。构建有效的贡献评估机制对激励参与者主动提供数据与算力至关重要,有助于提升整体系统性能并实现资源与奖励的合理分配。目前,基于Shapley值的方法被广泛采用,许多研究提出改进以适应真实场景。本文提出一种名为动态裁剪验证集Shapley(DPVS-Shapley)的组件,通过动态裁剪原始数据集,在不牺牲评估准确性的情况下显著加速贡献评估过程。此外,该组件可为不同样本分配不同权重,使具备区分难样本能力的客户端获得更高贡献评分。
原文摘要 · Abstract (English)
In the current era of artificial intelligence, federated learning has emerged as a novel approach to addressing data privacy concerns inherent in centralized learning paradigms. This decentralized learning model not only mitigates the risk of data breaches but also enhances the system's scalability and robustness. However, this approach introduces a new challenge: how to fairly and accurately assess the contribution of each participant. Developing an effective contribution evaluation mechanism is crucial for federated learning. Such a mechanism incentivizes participants to actively contribute their data and computational resources, thereby improving the overall performance of the federated learning system. By allocating resources and rewards based on the size of the contributions, it ensures that each participant receives fair treatment, fostering sustained engagement.Currently, Shapley value-based methods are widely used to evaluate participants' contributions, with many researchers proposing modifications to adapt these methods to real-world scenarios. In this paper, we introduce a component called Dynamic Pruning Validation Set Shapley (DPVS-Shapley). This method accelerates the contribution assessment process by dynamically pruning the original dataset without compromising the evaluation's accuracy. Furthermore, this component can assign different weights to various samples, thereby allowing clients capable of distinguishing difficult examples to receive higher contribution scores.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。