arXiv:2412.17818eess.SPcs.LG2024-12被引 2

用轻量适配器提升脑电图像任务分类,兼顾精度与效率

EEG-Based Mental Imagery Task Adaptation via Ensemble of Weight-Decomposed Low-Rank Adapters

  • 采用低秩分解的权重适配器集成方法,仅更新少量参数
  • 在语音与运动想象任务上超越全量微调和现有先进方法
  • 适合资源受限的实时脑机接口应用,尤其康复场景

脑电图(EEG)因其无创、便携、经济,被广泛用于脑机接口中的神经解码。然而,受个体间与个体内差异影响,性能受限。近年来深度学习模型虽表现优异,但计算与资源开销大,难以支持实时解码。通过迁移学习中的领域自适应技术(如微调与对抗训练)可缓解数据分布偏移问题,但需更新模型参数。参数高效微调(PEFT)仅需极小比例可训练参数,成为突破瓶颈的关键。本文针对语音与运动想象两类对中风后神经康复至关重要的任务,提出一种新型权重分解低秩适配器集成方法EDoRA,实现基于EEG信号分类的参数高效任务适配。在两个公开数据集(一个语音想象,一个运动想象)上验证,该方法在大量实验中优于全量微调及当前主流PEFT方法。

原文摘要 · Abstract (English)

Electroencephalography (EEG) is widely researched for neural decoding in Brain Computer Interfaces (BCIs) as it is non-invasive, portable, and economical. However, EEG signals suffer from inter- and intra-subject variability, leading to poor performance. Recent technological advancements have led to deep learning (DL) models that have achieved high performance in various fields. However, such large models are compute- and resource-intensive and are a bottleneck for real-time neural decoding. Data distribution shift can be handled with the help of domain adaptation techniques of transfer learning (fine-tuning) and adversarial training that requires model parameter updates according to the target domain. One such recent technique is Parameter-efficient fine-tuning (PEFT), which requires only a small fraction of the total trainable parameters compared to fine-tuning the whole model. Therefore, we explored PEFT methods for adapting EEG-based mental imagery tasks. We considered two mental imagery tasks: speech imagery and motor imagery, as both of these tasks are instrumental in post-stroke neuro-rehabilitation. We proposed a novel ensemble of weight-decomposed low-rank adaptation methods, EDoRA, for parameter-efficient mental imagery task adaptation through EEG signal classification. The performance of the proposed PEFT method is validated on two publicly available datasets, one speech imagery, and the other motor imagery dataset. In extensive experiments and analysis, the proposed method has performed better than full fine-tune and state-of-the-art PEFT methods for mental imagery EEG classification.

脑机接口低秩适配参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。