arXiv:2602.11945cs.LGcs.AI2026-02

解决异构联邦学习中数据与参与度差异导致的性能下降问题

Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios

  • 通过历史本地模型构建对比项,提升异构数据下更新一致性
  • 根据节点参与频次动态调整聚合权重,缓解参与不均影响
  • 融合历史全局模型降低跨轮次性能波动,适合资源不均场景

联邦学习(FL)允许多个节点在不共享原始数据的前提下协同训练模型。然而,实际部署常面临异构环境,节点间存在数据分布差异及参与频率不一致,导致性能下降。为此,本文提出PMFL框架,利用历史训练信息增强模型对比能力。节点侧通过引入历史本地模型设计新型模型对比项,捕捉稳定对比点,提升异构数据下的更新一致性;服务器端基于节点累计参与次数自适应调整聚合权重,修正因参与频率差异引起的全局目标偏差;同时,更新后的全局模型融合历史全局模型,降低相邻轮次间的性能波动。大量实验表明,相比现有方法,PMFL在异构场景下表现更优。

原文摘要 · Abstract (English)

Federated Learning (FL) enables multiple nodes to collaboratively train a model without sharing raw data. However, FL systems are usually deployed in heterogeneous scenarios, where nodes differ in both data distributions and participation frequencies, which undermines the FL performance. To tackle the above issue, this paper proposes PMFL, a performance-enhanced model-contrastive federated learning framework using historical training information. Specifically, on the node side, we design a novel model-contrastive term into the node optimization objective by incorporating historical local models to capture stable contrastive points, thereby improving the consistency of model updates in heterogeneous data distributions. On the server side, we utilize the cumulative participation count of each node to adaptively adjust its aggregation weight, thereby correcting the bias in the global objective caused by different node participation frequencies. Furthermore, the updated global model incorporates historical global models to reduce its fluctuations in performance between adjacent rounds. Extensive experiments demonstrate that PMFL achieves superior performance compared with existing FL methods in heterogeneous scenarios.

联邦学习异构场景模型对比性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。