arXiv:2504.00336cs.LGcs.AI2025-04被引 3

无需预训练的大型EEG模型,实现高精度时序级脑电检测。

Large EEG-U-Transformer for Time-Step Level Detection Without Pre-Training

  • 设计U型结构融合卷积与自注意力,捕捉局部与全局特征。
  • 直接输出时间步级预测,避免冗余重叠推理,提升效率。
  • 无需预训练即可超越大型模型,适合临床神经疾病检测。

脑电图(EEG)反映大脑功能状态,是癫痫检测和睡眠分期等应用的关键工具。传统深度学习模型因参数有限,性能受限;而大模型虽性能优越,但需大量预训练。此外,现有方法常依赖复杂的后处理将离散标签转为连续标注。本文基于EEG事件的多尺度特性,提出一种简单U型架构,通过卷积与自注意力模块实现序列到序列建模,高效捕获局部与全局特征。相比窗口级分类模型,本方法直接输出时间步级预测,消除冗余重叠推理。模型还可通过注意力池化层自然扩展至窗口级分类。实验表明,该设计在多种时间步与窗口级任务中实现优异效率、跨被试泛化及顶尖性能。更关键的是,模型仅用下游微调数据即达到甚至超越需大规模预训练的大型基础模型水平。本模型在2025年国际癫痫与神经疾病人工智能大会举办的癫痫检测挑战赛中荣获第一名。

原文摘要 · Abstract (English)

Electroencephalography (EEG) reflects the brain's functional state, making it a crucial tool for diverse detection applications like seizure detection and sleep stage classification. While deep learning-based approaches have recently shown promise for automated detection, traditional models are often constrained by limited learnable parameters and only achieve modest performance. In contrast, large foundation models showed improved capabilities by scaling up the model size, but required extensive time-consuming pre-training. Moreover, both types of existing methods require complex and redundant post-processing pipelines to convert discrete labels to continuous annotations. In this work, based on the multi-scale nature of EEG events, we propose a simple U-shaped model to efficiently learn representations by capturing both local and global features using convolution and self-attentive modules for sequence-to-sequence modeling. Compared to other window-level classification models, our method directly outputs predictions at the time-step level, eliminating redundant overlapping inferences. Beyond sequence-to-sequence modeling, the architecture naturally extends to window-level classification by incorporating an attention-pooling layer. Such a paradigm shift and model design demonstrated promising efficiency improvement, cross-subject generalization, and state-of-the-art performance in various time-step and window-level classification tasks in the experiment. More impressively, our model showed the capability to be scaled up to the same level as existing large foundation models that have been extensively pre-trained over diverse datasets and outperforms them by solely using the downstream fine-tuning dataset. Our model won 1st place in the 2025 "seizure detection challenge" organized in the International Conference on Artificial Intelligence in Epilepsy and Other Neurological Disorders.

脑电分析序列建模无预训练癫痫检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。