arXiv:2409.02495cs.LGcs.AI2024-09被引 3

无需验证数据,通过跨轮次相似性评估联邦学习贡献。

CoAst: Validation-Free Contribution Assessment for Federated Learning based on Cross-Round Valuation

  • 用权重量化筛选关键参数,减少训练随机性干扰。
  • 基于多轮通信中本地参数与全局更新的相似性评估贡献。
  • 实测效果接近有验证数据的方法,适合真实场景应用。

在联邦学习(FL)过程中,由于各参与方持有的数据不同,需判断各方对模型性能的贡献程度。有效的贡献评估可激励数据持有者参与训练。现有研究分为两类:依赖验证数据的方法需代表性验证集来衡量模型准确率,但在实际场景中难以获取;而现有的无验证方法仅基于单轮次的本地与全局模型参数、梯度进行评估,易受训练随机性影响。本文提出 CoAst,一种无需任何验证数据的联邦学习参与者贡献评估方法。其核心思想包含两点:一是通过权重量化仅保留模型参数中最重要的部分;二是基于当前本地参数与后续多个通信轮次中全局参数更新的相似性,实现跨轮次评估。大量实验表明,CoAst 的评估可靠性与现有依赖验证的方法相当,且优于已有无验证方法。

原文摘要 · Abstract (English)

In the federated learning (FL) process, since the data held by each participant is different, it is necessary to figure out which participant has a higher contribution to the model performance. Effective contribution assessment can help motivate data owners to participate in the FL training. Research works in this field can be divided into two directions based on whether a validation dataset is required. Validation-based methods need to use representative validation data to measure the model accuracy, which is difficult to obtain in practical FL scenarios. Existing validation-free methods assess the contribution based on the parameters and gradients of local models and the global model in a single training round, which is easily compromised by the stochasticity of model training. In this work, we propose CoAst, a practical method to assess the FL participants' contribution without access to any validation data. The core idea of CoAst involves two aspects: one is to only count the most important part of model parameters through a weights quantization, and the other is a cross-round valuation based on the similarity between the current local parameters and the global parameter updates in several subsequent communication rounds. Extensive experiments show that CoAst has comparable assessment reliability to existing validation-based methods and outperforms existing validation-free methods.

联邦学习贡献评估无验证跨轮次

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。