用知识蒸馏实现低通信开销的脑肿瘤联邦分类,支持异构模型架构。
FedBrain-Distill: Communication-Efficient Federated Brain Tumor Classification Using Ensemble Knowledge Distillation on Non-IID Data
- 基于集成教师蒸馏,让不同结构模型协同训练
- 非独立同分布数据下准确率超90%,通信量降低60%以上
- 适合医疗领域隐私保护场景,支持异构设备参与
大脑是人体最复杂的器官之一,其肿瘤分类仍面临巨大挑战。尽管机器学习结合磁共振成像(MRI)为肿瘤分型提供了新途径,但传统方法存在侵犯患者隐私的问题。联邦学习(FL)虽可缓解此问题,却存在通信开销大、依赖模型架构一致等缺陷。本文提出FedBrain-Distill,通过在联邦设置中引入知识蒸馏(KD),在保护用户隐私的同时允许客户端使用异构模型架构。该方法采用多教师集成蒸馏至轻量学生模型,在真实世界Figshare脑肿瘤数据集上对独立同分布(IID)和非独立同分布(non-IID)数据均取得高精度表现,且通信成本显著降低。实验采用狄利克雷分布生成非独立同分布数据。所有代码与实现细节已在GitHub公开。
原文摘要 · Abstract (English)
Brain is one the most complex organs in the human body. Due to its complexity, classification of brain tumors still poses a significant challenge, making brain tumors a particularly serious medical issue. Techniques such as Machine Learning (ML) coupled with Magnetic Resonance Imaging (MRI) have paved the way for doctors and medical institutions to classify different types of tumors. However, these techniques suffer from limitations that violate patients privacy. Federated Learning (FL) has recently been introduced to solve such an issue, but the FL itself suffers from limitations like communication costs and dependencies on model architecture, forcing all models to have identical architectures. In this paper, we propose FedBrain-Distill, an approach that leverages Knowledge Distillation (KD) in an FL setting that maintains the users privacy and ensures the independence of FL clients in terms of model architecture. FedBrain-Distill uses an ensemble of teachers that distill their knowledge to a simple student model. The evaluation of FedBrain-Distill demonstrated high-accuracy results for both Independent and Identically Distributed (IID) and non-IID data with substantial low communication costs on the real-world Figshare brain tumor dataset. It is worth mentioning that we used Dirichlet distribution to partition the data into IID and non-IID data. All the implementation details are accessible through our Github repository.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。