arXiv:2602.23504cs.LGcs.AI2026-02中稿 · ICLR被引 1

融合数据与梯度信息,提升异构环境下的联邦学习聚类效果

FedDAG: Clustered Federated Learning via Global Data and Gradient Integration for Heterogeneous Environments

  • 用数据和梯度联合度量客户端相似性,更全面地分组
  • 跨集群共享梯度优化模型,准确率显著优于现有方法
  • 适合数据异构严重的分布式场景,尤其对医疗、金融等隐私敏感领域

联邦学习(FL)允许客户端在不共享数据的前提下协同训练模型,但在客户端数据异构时性能下降。聚类联邦学习通过将相似客户端分组来缓解此问题。然而,现有方法仅依赖数据或梯度相似性,评估不完整;且知识仅限同组内共享,无法利用跨组多样性。为此,提出FedDAG框架,采用加权类别级相似性度量,融合数据与梯度信息,实现更全面的聚类。同时引入双编码器结构:主编码器基于本组数据训练,辅编码器通过其他组梯度微调,实现跨组特征迁移的同时保持组内特异性。在多个基准和异构设置下实验表明,FedDAG在准确率上持续优于当前最优聚类联邦学习基线。

原文摘要 · Abstract (English)

Federated Learning (FL) enables a group of clients to collaboratively train a model without sharing individual data, but its performance drops when client data are heterogeneous. Clustered FL tackles this by grouping similar clients. However, existing clustered FL approaches rely solely on either data similarity or gradient similarity; however, this results in an incomplete assessment of client similarities. Prior clustered FL approaches also restrict knowledge and representation sharing to clients within the same cluster. This prevents cluster models from benefiting from the diverse client population across clusters. To address these limitations, FedDAG introduces a clustered FL framework, FedDAG, that employs a weighted, class-wise similarity metric that integrates both data and gradient information, providing a more holistic measure of similarity during clustering. In addition, FedDAG adopts a dual-encoder architecture for cluster models, comprising a primary encoder trained on its own clients' data and a secondary encoder refined using gradients from complementary clusters. This enables cross-cluster feature transfer while preserving cluster-specific specialization. Experiments on diverse benchmarks and data heterogeneity settings show that FedDAG consistently outperforms state-of-the-art clustered FL baselines in accuracy.

联邦学习聚类异构数据跨组迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。