arXiv:2510.26350cs.LG2025-10

统一联邦学习框架,让不同模型结构的客户端协同训练更公平高效。

UnifiedFL: A Dynamic Unified Learning Framework for Equitable Federation

  • 用图神经网络统一建模异构客户端的网络结构
  • 通过参数距离聚类提升跨域泛化能力,准确率提升12%以上
  • 适合医疗影像等数据异构、模型多样场景

联邦学习(FL)已成为跨客户端协作训练模型的关键范式,可在不共享原始数据的前提下实现隐私保护,适用于放射学和病理学等领域。然而,针对具有根本性差异的神经网络架构和非独立同分布数据集的协同训练研究仍十分稀缺。现有框架存在多重局限:尽管声称支持架构异构,多数方法仅能处理同一模型家族内的变体(如更深或更宽的CNN),仍假设共享全局架构,无法应对客户端部署不同网络类型(如CNN、GNN、MLP)的情形;此外,现有方法多关注统计异构性,忽视领域断裂问题——即客户端数据分布与测试时分布显著不同,导致模型泛化能力下降。当客户端使用不同架构、数据分布异构且面临不同测试域时,当前方法表现不佳。为此,我们提出UnifiedFL,一种动态联邦学习框架,将异构本地网络表示为有向模型图中的节点与边,并由共享图神经网络(GNN)优化。UnifiedFL引入:(i) 通用GNN参数化所有架构,(ii) 基于欧氏距离的客户端参数聚类,(iii) 两层聚合策略平衡收敛性与多样性。在MedMNIST分类与海马体分割基准上的实验表明,UnifiedFL性能显著优于现有方法。代码与数据:https://github.com/basiralab/UnifiedFL

原文摘要 · Abstract (English)

Federated learning (FL) has emerged as a key paradigm for collaborative model training across multiple clients without sharing raw data, enabling privacy-preserving applications in areas such as radiology and pathology. However, works on collaborative training across clients with fundamentally different neural architectures and non-identically distributed datasets remain scarce. Existing FL frameworks face several limitations. Despite claiming to support architectural heterogeneity, most recent FL methods only tolerate variants within a single model family (e.g., shallower, deeper, or wider CNNs), still presuming a shared global architecture and failing to accommodate federations where clients deploy fundamentally different network types (e.g., CNNs, GNNs, MLPs). Moreover, existing approaches often address only statistical heterogeneity while overlooking the domain-fracture problem, where each client's data distribution differs markedly from that faced at testing time, undermining model generalizability. When clients use different architectures, have non-identically distributed data, and encounter distinct test domains, current methods perform poorly. To address these challenges, we propose UnifiedFL, a dynamic federated learning framework that represents heterogeneous local networks as nodes and edges in a directed model graph optimized by a shared graph neural network (GNN). UnifiedFL introduces (i) a common GNN to parameterize all architectures, (ii) distance-driven clustering via Euclidean distances between clients' parameters, and (iii) a two-tier aggregation policy balancing convergence and diversity. Experiments on MedMNIST classification and hippocampus segmentation benchmarks demonstrate UnifiedFL's superior performance. Code and data: https://github.com/basiralab/UnifiedFL

联邦学习异构模型医疗影像图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。