arXiv:2510.13497cs.LGcs.AI2025-10被引 16

用脑电与文本多模态融合提升癫痫检测精度,还蒸馏出轻量模型。

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation

  • 融合脑电与文本描述,用双编码器在共享空间学特征
  • 三数据集准确率超97%,F1值均超0.94,表现稳定可靠
  • 蒸馏后模型参数减至原模型58.1%,适合资源受限场景

癫痫是一种常见的神经系统疾病,表现为由异常电活动引起的突发短暂神经元过度放电,可能导致精神障碍。现有深度学习方法大多仅依赖单模态脑电(EEG)信号,忽视了多模态信息的潜力。为此,我们提出一种基于CLIP框架的新型多模态模型DistilCLIP-EEG,融合EEG信号与文本描述以捕捉癫痫发作的全面特征。该模型采用基于Conformer架构的EEG编码器和提出的可学习BERT(BERT-LP)作为提示学习模块,嵌入在编码器中,二者在共享潜在空间实现高效的跨模态表示学习。为提升效率与适应性,引入知识蒸馏方法:训练好的DistilCLIP-EEG作为教师模型,指导更紧凑的学生模型,降低训练复杂度与时间。在TUSZ、AUBMC和CHB-MIT数据集上,师生模型准确率均超过97%;所有数据集的F1分数均保持在0.94以上,证明了该框架的鲁棒性与可靠性。此外,学生模型的参数量和模型大小约为教师模型的58.1%,显著降低模型复杂度与存储需求,同时保持高性能。结果表明,该模型在基于EEG的癫痫检测中具有巨大潜力,并为资源受限环境部署轻量化模型奠定了坚实基础。

原文摘要 · Abstract (English)

Epilepsy is a prevalent neurological disorder marked by sudden, brief episodes of excessive neuronal activity caused by abnormal electrical discharges, which may lead to some mental disorders. Most existing deep learning methods for epilepsy detection rely solely on unimodal EEG signals, neglecting the potential benefits of multimodal information. To address this, we propose a novel multimodal model, DistilCLIP-EEG, based on the CLIP framework, which integrates both EEG signals and text descriptions to capture comprehensive features of epileptic seizures. The model involves an EEG encoder based on the Conformer architecture as a text encoder, the proposed Learnable BERT (BERT-LP) as prompt learning within the encoders. Both operate in a shared latent space for effective cross-modal representation learning. To enhance efficiency and adaptability, we introduce a knowledge distillation method where the trained DistilCLIP-EEG serves as a teacher to guide a more compact student model to reduce training complexity and time. On the TUSZ, AUBMC, and CHB-MIT datasets, both the teacher and student models achieved accuracy rates exceeding 97%. Across all datasets, the F1-scores were consistently above 0.94, demonstrating the robustness and reliability of the proposed framework. Moreover, the student model's parameter count and model size are approximately 58.1% of those of the teacher model, significantly reducing model complexity and storage requirements while maintaining high performance. These results highlight the potential of our proposed model for EEG-based epilepsy detection and establish a solid foundation for deploying lightweight models in resource-constrained settings.

癫痫检测多模态学习知识蒸馏轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。