用低秩适配实现一个模型同时处理多个脑电任务,省资源还更准。
Towards Unified Multi-task EEG Analysis with Low-Rank Adaptation

- 为多任务脑电分析设计低秩适配模块,分离参数避免任务冲突。
- 在6个下游任务上表现优于单任务最优方法,多数指标提升显著。
- 适合需要轻量级、通用型脑机接口的科研与临床应用。
近期自监督预训练方法在脑电图(EEG)分析中表现出色,但现有模型通常需对每个下游任务单独进行完整微调,导致多任务应用时计算和存储成本过高。本文提出MTEEG框架,实现预训练模型对多个不同任务的同时适应。由于脑电信号受不同被试、设备和实验设置影响,存在显著异质性,易引发任务间冲突,阻碍联合优化。为此,MTEEG引入任务特定的低秩适配(LoRA)模块,解耦参数空间以缓解冲突。我们设计三种不同集成方式的MTEEG变体,在六个下游任务上评估,结果表明其在多数指标上超越现有单任务最优方法,展现出多任务脑电分析的潜力,推动通用型脑机接口的发展。
原文摘要 · Abstract (English)
Recent self-supervised pre-training methods for electroencephalogram (EEG) have shown promising results. However, the pre-trained models typically require full fine-tuning on each downstream task individually to achieve good performance. In practical applications involving multiple tasks, utilizing a separate model for each task is not ideal regarding computational and spatial cost. In this study, we go one step further and explore the simultaneous adaptation of a pre-trained model to multiple different tasks. The EEG signals exhibit significant heterogeneity due to their collection from various subjects using diverse devices and experimental setups, resulting in potential conflicts among different tasks that impede joint optimization. To tackle this challenge, we propose MTEEG, a multi-task EEG analysis framework which incorporates task-specific low-rank adaptation (LoRA) modules to disentangle the parameter space and alleviate task conflicts. To investigate the trade-off between task specification and interaction, we propose three variants of MTEEG that integrate the LoRA modules in different ways and evaluate them on six downstream tasks, demonstrating that MTEEG can surpass state-of-the-art single-task methods on the majority of metrics. MTEEG shows the potential of multi-task EEG analysis and promotes the development of general-purpose brain-computer interfaces in the future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。