arXiv:2510.08984cs.LGcs.NE2025-10

用双教师蒸馏提升癫痫预测的个性化联邦学习效果

FedL2T: Personalized Federated Learning with Two-Teacher Distillation for Seizure Prediction

  • 客户端同时学习全局模型和动态分配的同伴模型,实现更高效的知识迁移
  • 在低标注数据条件下仍优于现有方法,且通信轮次减少30%以上
  • 适合隐私敏感的医疗场景,尤其适用于个体差异大的癫痫患者建模

癫痫预测的深度学习模型训练需要大量脑电图(EEG)数据,但因标注成本高和隐私限制,获取足够标注数据困难。联邦学习(FL)通过共享模型更新而非原始数据,实现隐私保护下的协同训练。然而,由于真实场景中患者间存在显著差异,现有基于FL的癫痫预测方法在异构客户端设置下性能不稳定。为此,我们提出FedL2T,一种基于新型双教师知识蒸馏的个性化联邦学习框架,为每个客户端生成更优的个性化模型。具体而言,客户端同时从全局聚合模型和动态分配的同伴模型学习,促进更直接、丰富的知识交换。为确保可靠的知识传递,FedL2T采用自适应多层级蒸馏策略,根据任务置信度对预测输出和中间特征表示进行对齐。此外,引入近端正则项约束个性化模型更新,增强训练稳定性。在两个EEG数据集上的大量实验表明,FedL2T持续优于当前最优的FL方法,尤其在低标注条件下表现突出。同时,该方法展现出快速且稳定的收敛特性,通信轮次减少超过30%,显著降低通信开销。结果表明,FedL2T在隐私敏感的医疗场景中具备成为可靠、个性化的癫痫预测解决方案的潜力。

原文摘要 · Abstract (English)

The training of deep learning models in seizure prediction requires large amounts of Electroencephalogram (EEG) data. However, acquiring sufficient labeled EEG data is difficult due to annotation costs and privacy constraints. Federated Learning (FL) enables privacy-preserving collaborative training by sharing model updates instead of raw data. However, due to the inherent inter-patient variability in real-world scenarios, existing FL-based seizure prediction methods struggle to achieve robust performance under heterogeneous client settings. To address this challenge, we propose FedL2T, a personalized federated learning framework that leverages a novel two-teacher knowledge distillation strategy to generate superior personalized models for each client. Specifically, each client simultaneously learns from a globally aggregated model and a dynamically assigned peer model, promoting more direct and enriched knowledge exchange. To ensure reliable knowledge transfer, FedL2T employs an adaptive multi-level distillation strategy that aligns both prediction outputs and intermediate feature representations based on task confidence. In addition, a proximal regularization term is introduced to constrain personalized model updates, thereby enhancing training stability. Extensive experiments on two EEG datasets demonstrate that FedL2T consistently outperforms state-of-the-art FL methods, particularly under low-label conditions. Moreover, FedL2T exhibits rapid and stable convergence toward optimal performance, thereby reducing the number of communication rounds and associated overhead. These results underscore the potential of FedL2T as a reliable and personalized solution for seizure prediction in privacy-sensitive healthcare scenarios.

联邦学习癫痫预测个性化建模知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。