arXiv:2506.16731cs.AIcs.DC2025-06

为联邦学习设计激励机制,让参与方更愿提供高质量数据。

Incentivizing High-quality Participation From Federated Learning Agents

  • 用Wasserstein距离衡量数据贡献差异,优化模型收敛速度。
  • 通过同行评估机制识别并奖励真实高质量贡献者。
  • 基于两阶段斯塔克尔伯格博弈,确保激励机制可实现均衡。

联邦学习(FL)为多个客户端在不直接共享本地数据的前提下联合训练全局模型提供了可行方案。然而现有研究存在两大问题:1)现有方法通常假设参与方自愿且无私,但自利的代理可能选择退出或提交低质量数据;2)机制设计者视角下,聚合模型效果不佳,因现有基于博弈论的联邦学习数据收集方法忽略了数据贡献带来的潜在异质性努力。为缓解上述挑战,我们提出一种考虑数据异质性的激励感知参与框架,以加速收敛过程。具体而言,首先引入Wasserstein距离来显式刻画异质性努力,并重构收敛上界。为诱导代理诚实报告,利用同行预测机制分析并测量任意两个代理的泛化误差差距,构建评分函数。进一步提出一个两阶段斯塔克尔伯格博弈模型,形式化该过程并验证均衡的存在性。在真实数据集上的大量实验验证了所提机制的有效性。

原文摘要 · Abstract (English)

Federated learning (FL) provides a promising paradigm for facilitating collaboration between multiple clients that jointly learn a global model without directly sharing their local data. However, existing research suffers from two caveats: 1) From the perspective of agents, voluntary and unselfish participation is often assumed. But self-interested agents may opt out of the system or provide low-quality contributions without proper incentives; 2) From the mechanism designer's perspective, the aggregated models can be unsatisfactory as the existing game-theoretical federated learning approach for data collection ignores the potential heterogeneous effort caused by contributed data. To alleviate above challenges, we propose an incentive-aware framework for agent participation that considers data heterogeneity to accelerate the convergence process. Specifically, we first introduce the notion of Wasserstein distance to explicitly illustrate the heterogeneous effort and reformulate the existing upper bound of convergence. To induce truthful reporting from agents, we analyze and measure the generalization error gap of any two agents by leveraging the peer prediction mechanism to develop score functions. We further present a two-stage Stackelberg game model that formalizes the process and examines the existence of equilibrium. Extensive experiments on real-world datasets demonstrate the effectiveness of our proposed mechanism.

联邦学习激励机制数据异质性博弈论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。