arXiv:2503.07869cs.LGcs.AI2025-03中稿 · publication in IEE…被引 2

针对联邦学习早期关键阶段,设计动态激励机制提升高质量参与。

Carpe Diem: Critical Learning Period-Aware Contract-Based Incentives for Federated Learning

  • 基于合同理论设计时序感知激励,优先吸引优质客户端参与初期训练。
  • 实验显示可提升2-3倍训练速度,降低5.2%-47.6%客户端需求,最高提升9%准确率。
  • 适合关注联邦学习效率与激励公平性的研究者和工业应用开发者。

联邦学习中的关键学习期(CLPs)指早期阶段,此时低质量贡献(如数据稀疏)会永久损害全局模型性能。现有激励机制通常假设各轮次同等重要,未能针对性激励关键期的高质量参与。隐私限制导致信息不对称,云端无法掌握客户端真实能力,引发逆向选择与道德风险。为此,本文提出时序感知的合同论激励框架R3T,通过构建云方效用函数,权衡模型性能与奖励支出,显式建模客户端在能力、努力程度与加入时间上的异质性。设计满足个体理性、激励相容与预算可行性的最优契约,引导理性客户端在关键期尽早参与并投入努力。实验证明,R3T有效缓解信息不对称,提升云方效用,经济效率优于传统机制。原型系统实现2-3倍训练加速,达目标性能所需客户端池减少5.2%-47.6%,最终准确率最高提升9%。源码见https://github.com/linhnt31/R3T。

原文摘要 · Abstract (English)

Critical learning periods (CLPs) in federated learning (FL) refer to early stages during which low-quality contributions (e.g., sparse training data availability) can permanently impair the performance of the global model. However, existing incentive mechanisms typically assume temporal homogeneity, treating all training rounds as equally important, thereby failing to prioritize and attract high-quality contributions during CLPs. This inefficiency is compounded by information asymmetry due to privacy regulations, where the cloud lacks knowledge of client training capabilities, leading to adverse selection and moral hazard. Thus, in this article, we propose a time-aware contract-theoretic incentive framework, named Right Reward Right Time (R3T), to encourage client involvement, especially during CLPs, to maximize the utility of the cloud. We formulate a cloud utility function that captures the trade-off between the achieved model performance and rewards allocated for clients' contributions, explicitly accounting for client heterogeneity in system capabilities, effort, and joining time. Then, we devise a CLP-aware incentive mechanism deriving an optimal contract design that satisfies individual rationality, incentive compatibility, and budget feasibility constraints, motivating rational clients to participate early and contribute efforts. By providing the right reward at the right time, our approach can attract the highest-quality contributions during CLPs. Simulation studies show that R3T mitigates information asymmetry, increases cloud utility, and yields superior economic efficiency compared to conventional incentive mechanisms. Our proof-of-concept yields a 2-3x training speedup, reduces the required client pool by 5.2-47.6% to reach target performance, and improves final accuracy by up to 9%. The source code can be found at https://github.com/linhnt31/R3T.

联邦学习激励机制合同理论关键期

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。