arXiv:2503.18981cs.LGcs.AI2025-03中稿 · IEEE-TNNLS, 17 pag…被引 1

无需中心聚合,通过多维知识蒸馏实现异构医疗模型高效协作。

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification

  • 采用轮转式模型传递,避免中心化聚合,支持完全异构模型结构。
  • 在脑部MRI和皮肤病变数据上,个人化准确率和跨机构适应性均领先基准。
  • 适合资源受限、模型各异的医疗联邦学习场景,兼顾效率与性能。

联邦学习(FL)可在不直接共享数据的前提下实现隐私保护下的协同建模。模型异构联邦学习(MHFL)进一步允许客户端基于自身计算资源和应用需求,训练具有异构架构的个性化模型。然而,现有MHFL方法大多依赖中心化聚合,存在可扩展性和效率瓶颈,或要求客户端部分模型结构一致。虽点对点(P2P)FL消除了服务器依赖,但在异构环境下易出现模型漂移和知识稀释。为此,我们提出FedSKD,一种新型MHFL框架,通过轮转式模型循环实现客户端间直接知识交换,无需中心聚合,且支持全异构模型结构。其核心创新为多维相似性知识蒸馏,可在批次、像素/体素、区域层面实现异构模型间的双向知识迁移,通过渐进强化与分布对齐缓解灾难性遗忘与模型漂移,同时保持模型异构性。在基于功能性磁共振成像的自闭症谱系障碍诊断和皮肤病变分类任务上的大量实验表明,FedSKD优于当前最优的异构与同构联邦学习基线,在个人化准确率(客户端特定精度)与泛化能力(跨机构适应性)上均表现更优。这些结果凸显了FedSKD在真实医疗联邦学习应用中的可扩展性与鲁棒性潜力。

原文摘要 · Abstract (English)

Federated learning (FL) enables privacy-preserving collaborative model training without direct data sharing. Model-heterogeneous FL (MHFL) extends this paradigm by allowing clients to train personalized models with heterogeneous architectures tailored to their computational resources and application-specific needs. However, existing MHFL methods predominantly rely on centralized aggregation, which introduces scalability and efficiency bottlenecks, or impose restrictions requiring partially identical model architectures across clients. While peer-to-peer (P2P) FL removes server dependence, it suffers from model drift and knowledge dilution, limiting its effectiveness in heterogeneous settings. To address these challenges, we propose FedSKD, a novel MHFL framework that facilitates direct knowledge exchange through round-robin model circulation, eliminating the need for centralized aggregation while allowing fully heterogeneous model architectures across clients. FedSKD's key innovation lies in multi-dimensional similarity knowledge distillation, which enables bidirectional cross-client knowledge transfer at batch, pixel/voxel, and region levels for heterogeneous models in FL. This approach mitigates catastrophic forgetting and model drift through progressive reinforcement and distribution alignment while preserving model heterogeneity. Extensive evaluations on fMRI-based autism spectrum disorder diagnosis and skin lesion classification demonstrate that FedSKD outperforms state-of-the-art heterogeneous and homogeneous FL baselines, achieving superior personalization (client-specific accuracy) and generalization (cross-institutional adaptability). These findings underscore FedSKD's potential as a scalable and robust solution for real-world medical federated learning applications.

联邦学习医疗图像异构模型知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。