T-TIME让脑机接口用前无需校准,实时适应新用户。
T-TIME: Test-Time Information Maximization Ensemble for Plug-and-Play BCIs
- 新用户数据流到来时,动态更新多个分类器提升性能。
- 在3个公开数据集上超越20种经典与前沿方法。
- 适合希望实现即插即用脑机接口的研究者与开发者。
基于脑电图(EEG)的脑机接口(BCI)实现了人脑与计算机的直接通信。由于个体差异和EEG信号的非平稳性,传统BCI通常需要每次使用前进行特定用户的校准,耗时且不友好。迁移学习(TL)被提出以缩短或消除校准过程,但现有方法多局限于离线设置,即所有未标注的用户数据可提前获取。本文提出测试时信息最大化集成方法(T-TIME),适用于最严苛的在线迁移学习场景:新用户未标注的EEG数据以流式方式持续到达,需立即进行分类。T-TIME从对齐的源数据初始化多个分类器;当一个未标注的测试EEG试次到达时,先通过集成学习预测标签,再通过条件熵最小化和自适应边缘分布正则化更新每个分类器。代码已公开。在三个公开的运动想象基BCI数据集上的大量实验表明,T-TIME显著优于约20种经典与先进迁移学习方法。据我们所知,这是首个针对无校准脑机接口的测试时适应工作,为即插即用的脑机接口提供了可能。
原文摘要 · Abstract (English)
Objective: An electroencephalogram (EEG)-based brain-computer interface (BCI) enables direct communication between the human brain and a computer. Due to individual differences and non-stationarity of EEG signals, such BCIs usually require a subject-specific calibration session before each use, which is time-consuming and user-unfriendly. Transfer learning (TL) has been proposed to shorten or eliminate this calibration, but existing TL approaches mainly consider offline settings, where all unlabeled EEG trials from the new user are available. Methods: This paper proposes Test-Time Information Maximization Ensemble (T-TIME) to accommodate the most challenging online TL scenario, where unlabeled EEG data from the new user arrive in a stream, and immediate classification is performed. T-TIME initializes multiple classifiers from the aligned source data. When an unlabeled test EEG trial arrives, T-TIME first predicts its labels using ensemble learning, and then updates each classifier by conditional entropy minimization and adaptive marginal distribution regularization. Our code is publicized. Results: Extensive experiments on three public motor imagery based BCI datasets demonstrated that T-TIME outperformed about 20 classical and state-of-the-art TL approaches. Significance: To our knowledge, this is the first work on test time adaptation for calibration-free EEG-based BCIs, making plug-and-play BCIs possible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。