用测试时训练让脑电模型更准,无需标注数据就能适应新用户。
NeuroTTT: Bridging Pretraining-Downstream Task Misalignment in EEG Foundation Models via Test-Time Training
- 先用自监督微调对齐脑电信号特征,再在推理时动态调整模型。
- 在三种脑机任务中准确率显著提升,最高超基线12.3%。
- 适合想快速适配新用户的脑电应用开发者。
大规模脑电基础模型为通用脑机接口提供了前景,但其预训练目标与下游任务常存在偏差,且跨被试分布差异大。本文提出两阶段对齐策略:首先引入NeuroTTT,一种领域特定的自监督微调范式,通过任务相关自监督目标增强模型,对齐谱、空间和时间特征,无需额外标注数据;其次在推理时引入测试时训练(TTT),对每个未标记测试样本进行自监督训练,并结合预测熵最小化(Tent)仅更新归一化统计量,实时校准模型以应对新输入。该方法首次在大规模脑电基础模型中统一域内自监督与测试时训练,使用CBraMod和LaBraM作为主干网络,在想象言语、压力检测、运动想象三项任务上均达到领先性能,显著优于传统微调与适应方法。代码已开源。
原文摘要 · Abstract (English)
Large-scale foundation models for EEG signals offer a promising path to generalizable brain-computer interface (BCI) applications, but they often suffer from misalignment between pretraining objectives and downstream tasks, as well as significant cross-subject distribution shifts. This paper addresses these challenges by introducing a two-stage alignment strategy that bridges the gap between generic pretraining and specific EEG decoding tasks. First, we propose NeuroTTT: a domain-specific self-supervised fine-tuning paradigm that augments the foundation model with task-relevant self-supervised objectives, aligning latent representations to important spectral, spatial, and temporal EEG features without requiring additional labeled data. Second, we incorporate test-time training (TTT) at inference, we perform (i) self-supervised test-time training on individual unlabeled test samples and (ii) prediction entropy minimization (Tent), which updates only normalization statistics to continually calibrate the model to each new input on the fly. Our approach, which, to our knowledge, is the first to unify domain-tuned self-supervision with test-time training in large-scale EEG foundation models, yields substantially improved robustness and accuracy across diverse BCI tasks (imagined speech, stress detection, motor imagery). Using CBraMod and LaBraM as backbones, our method pushes their performance to a markedly higher level. Results on three diverse tasks demonstrate that the proposed alignment strategy achieves state-of-the-art performance, outperforming conventional fine-tuning and adaptation methods. Our code is available at https://github.com/wsl2000/NeuroTTT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。