arXiv:2605.05959cs.AIcs.DC2026-05

提出结构对齐方法,提升异构联邦学习性能

From Coordinate Matching to Structural Alignment: Rethinking Prototype Alignment in Heterogeneous Federated Learning

论文配图:From Coordinate Matching to Structural Alignment: Rethinking Prototype Alignment in Heterogeneous Federated Learning
图 1 · 摘自论文原文
  • 用类间关系结构替代坐标对齐,避免强制共享特征空间
  • 在多个基准上相比最优方法最高提升3.52%
  • 适合模型差异大的联邦学习场景

异构联邦学习(HtFL)旨在让数据分布和模型架构均不同的客户端协同合作。基于原型的方法通过通信类别级特征中心(原型)而非完整模型参数,展现出良好潜力。现有原型方法沿用同构联邦学习中的MSE或余弦对齐机制,本质上是坐标对齐,要求客户端表示在嵌入空间中逐元素匹配全局原型。该假设在同构场景合理,但在异构场景下不合理,因为不同特征提取器自然形成各自特征子空间,强制所有客户端优化于单一全局子空间会抑制其学习能力。我们发现坐标对齐隐含耦合了两个不同目标:对齐类间语义结构(有益于分类),以及强制共享特征基底(在模型异构时不必要甚至有害)。基于此洞察,我们提出FedSAF,将对齐目标从绝对坐标转向类间关系结构。实验表明,在多个基准上,结构对齐持续优于坐标对齐,性能最高提升3.52%。

原文摘要 · Abstract (English)

Heterogeneous federated learning (HtFL) aims to enable collaboration among clients that differ in both data distributions and model architectures. Prototype-based methods, which communicate class-level feature centers (prototypes) instead of full model parameters, have recently shown strong potential for HtFL. Existing prototype-based HtFL methods typically reuse the MSE-based or cosine-based alignment mechanism developed for homogeneous FL when aligning client-specific representations with global prototypes. These approaches are essentially coordinate alignment, where representations of clients are forced to match the global prototypes in the embedding space in an element-wise manner. Such alignment implicitly assumes that all clients should map their representations into the feature subspace defined by the global prototypes. This assumption is reasonable in homogeneous FL, where all clients share the same feature extractor. However, it becomes problematic in HtFL, since heterogeneous feature extractors naturally induce client-specific feature subspaces, and forcing all clients to optimize within a single global subspace unnecessarily suppresses their learning capacity. We observe that coordinate alignment implicitly couples two distinct objectives: aligning inter-class semantic structure, which is directly beneficial for classification, and enforcing a shared feature basis, which is unnecessary and even harmful under model heterogeneity. Building on this insight, we design FedSAF, which shifts the alignment objective from absolute coordinates to inter-class relational structure. We demonstrate that structural alignment consistently outperforms coordinate alignment in heterogeneous settings. Experiments on multiple benchmarks show that our structural alignment outperforms state-of-the-art prototype-based HtFL methods by up to 3.52\%.

联邦学习异构模型结构对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。