针对脑电图信号设计自适应大模型,提升跨任务泛化能力
ALFEE: Adaptive Large Foundation Model for EEG Representation
- 分通道与时间动态建模的混合注意力架构,支持不同通道数输入
- 预训练2.5万小时后在6个下游任务中超越现有模型
- 适合神经科学、脑机接口等需要高精度脑电信号分析的研究者
尽管基础模型在文本、图像和视频领域表现优异,但关键生物信号——尤其是脑电图(EEG)——仍研究不足。EEG具有高时间分辨率、操作便捷性和安全性优势,但低信噪比、个体差异和跨范式差异限制了现有模型的泛化能力。现有方法多采用简化策略,如单一损失函数或通道-时间联合表示模块,并存在预训练与评估任务间的领域差距,影响效率与适应性。为此,我们提出自适应大基础模型用于脑电图表征(ALFEE),一种新型混合变压器架构,包含两个学习阶段以实现鲁棒的脑电图表征学习。ALFEE采用分离通道特征聚合与时间动态建模的混合注意力机制,可适应不同通道配置。通道编码器自适应压缩变通道信息,时间编码器捕捉任务引导的演化过程,混合解码器在时间和频率域重建信号。预训练阶段优化任务预测、通道与时间掩码重建及时间预测,增强多尺度与多通道表征。微调阶段通过任务特定词典与交叉注意力层实现全模型适配,显著提升多任务性能。经25,000小时预训练后,在六个下游脑电任务上的实验结果表明,ALFEE优于现有模型。本框架为生物信号分析提供了可扩展的基础,代码已开源。
原文摘要 · Abstract (English)
While foundation models excel in text, image, and video domains, the critical biological signals, particularly electroencephalography(EEG), remain underexplored. EEG benefits neurological research with its high temporal resolution, operational practicality, and safety profile. However, low signal-to-noise ratio, inter-subject variability, and cross-paradigm differences hinder the generalization of current models. Existing methods often employ simplified strategies, such as a single loss function or a channel-temporal joint representation module, and suffer from a domain gap between pretraining and evaluation tasks that compromises efficiency and adaptability. To address these limitations, we propose the Adaptive Large Foundation model for EEG signal representation(ALFEE) framework, a novel hybrid transformer architecture with two learning stages for robust EEG representation learning. ALFEE employs a hybrid attention that separates channel-wise feature aggregation from temporal dynamics modeling, enabling robust EEG representation with variable channel configurations. A channel encoder adaptively compresses variable channel information, a temporal encoder captures task-guided evolution, and a hybrid decoder reconstructs signals in both temporal and frequency domains. During pretraining, ALFEE optimizes task prediction, channel and temporal mask reconstruction, and temporal forecasting to enhance multi-scale and multi-channel representation. During fine-tuning, a full-model adaptation with a task-specific token dictionary and a cross-attention layer boosts performance across multiple tasks. After 25,000 hours of pretraining, extensive experimental results on six downstream EEG tasks demonstrate the superior performance of ALFEE over existing models. Our ALFEE framework establishes a scalable foundation for biological signal analysis with implementation at https://github.com/xw1216/ALFEE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。