arXiv:2607.26801cs.LGcs.AI2026-07

FedTopo通过共享类别间关系拓扑,解决异构模型在联邦学习中的知识传递难题。

FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning

论文配图:FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning
图 1 · 摘自论文原文
  • 以类别关系拓扑代替传统参数或特征共享,捕捉类间相对关系
  • 在8种异构骨干网络上,准确率超越基线方法2.1%~6.3%
  • 适合异构模型场景,通信开销低且无推理延迟

联邦学习(FL)可在不集中原始数据的前提下实现跨数据孤岛的协同学习。然而,本地架构异构常导致表示空间不对齐,难以有效传递全局知识。现有方法通过共享模型参数、蒸馏预测或类别原型来传递知识,但均基于绝对空间,需客户端间对齐,而异构主干网络破坏此对齐,使共享知识不可靠并误导本地训练。本文提出FedTopo,一种关系级框架,将全局知识编码为类别关系拓扑,捕捉每个客户端内部类之间的相对关系,而非其在特征空间中的绝对位置。各客户端基于本地原型构建关系拓扑,并上传包含类别统计信息的拓扑。服务器以可靠性感知方式聚合这些关系,对支持度弱的关系进行降权,并将全局拓扑广播至客户端。全局拓扑通过强调拓扑相似的负类来指导本地训练。在三个数据集上,使用八种异构骨干网络的实验表明,FedTopo持续优于参数共享、蒸馏和原型共享基线,通信开销低,且无推理开销。代码已开源。

原文摘要 · Abstract (English)

Federated learning (FL) enables collaborative learning over decentralized data silos without centralizing raw data. However, heterogeneous local architectures often induce non-aligned representation spaces, making it difficult to transfer global knowledge across silos. Existing paradigms share this knowledge as model parameters, distilled predictions, or class prototypes, yet all encode it in an absolute space that must be aligned across clients. Heterogeneous backbones break this alignment, so the shared knowledge becomes unreliable and misleads local training. We propose FedTopo, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space. Each client builds its relation topology from local prototypes and uploads it with class statistics. The server then aggregates these relations in a reliability-aware manner that down-weights weakly supported ones, and broadcasts the global topology to clients. The global topology guides local training by emphasizing topology-similar negative classes. Experiments on three datasets under eight heterogeneous backbones show that FedTopo consistently outperforms parameter-, distillation-, and prototype-sharing baselines, with low communication and no inference overhead. Our code is available at https://github.com/Zhaoyang-Ma/FedTopo.

联邦学习异构模型关系拓扑知识共享

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。