让脑机接口新手也能用,通过类敏感风格迁移提升脑电识别准确率
CSSSTN: A Class-sensitive Subject-to-subject Semantic Style Transfer Network for EEG Classification in RSVP Tasks
- 按类别对齐专家与新手的脑电特征分布,实现精准跨人迁移
- 在清华和哈工大数据集上分别提升6.4%和3.5%的平均准确率
- 只需少量目标数据即可生效,适合无经验用户快速上手
快速序列视觉呈现(RSVP)是脑机接口(BCI)中极具前景的应用范式。然而,跨被试差异仍是关键挑战,尤其对不熟悉BCI的用户而言。为此,我们提出类敏感的主体间语义风格迁移网络(CSSSTN),在类别层面将专家被试(BCI专家)与目标被试(BCI初学者)的特征分布对齐。基于SSSTN框架,引入三项核心组件:(1) 主体特异性分类器训练,(2) 一种独特风格损失,结合改进的内容损失,在传递类别判别特征的同时保留语义信息,(3) 融合源域与目标域预测的集成策略。在公开数据集与自采数据集上评估,结果表明CSSSTN优于现有方法,在清华数据集上平均平衡准确率提升6.4%,哈工大数据集提升3.5%,对初学者尤为显著。消融实验验证各组件有效性,尤其是类敏感迁移与低层特征的使用,可增强迁移效果并抑制负迁移。此外,该模型仅需极少目标数据即可达到良好性能,大幅降低校准成本。研究结果凸显其在真实场景中的应用潜力,为提升非专业用户性能提供鲁棒、可扩展的解决方案。代码已开源。
原文摘要 · Abstract (English)
The Rapid Serial Visual Presentation (RSVP) paradigm represents a promising application of electroencephalography (EEG) in Brain-Computer Interface (BCI) systems. However, cross-subject variability remains a critical challenge, particularly for BCI-illiterate users who struggle to effectively interact with these systems. To address this issue, we propose the Class-Sensitive Subject-to-Subject Semantic Style Transfer Network (CSSSTN), which incorporates a class-sensitive approach to align feature distributions between golden subjects (BCI experts) and target (BCI-illiterate) users on a class-by-class basis. Building on the SSSTN framework, CSSSTN incorporates three key components: (1) subject-specific classifier training, (2) a unique style loss to transfer class-discriminative features while preserving semantic information through a modified content loss, and (3) an ensemble approach to integrate predictions from both source and target domains. We evaluated CSSSTN using both a publicly available dataset and a self-collected dataset. Experimental results demonstrate that CSSSTN outperforms state-of-the-art methods, achieving mean balanced accuracy improvements of 6.4\% on the Tsinghua dataset and 3.5\% on the HDU dataset, with notable benefits for BCI-illiterate users. Ablation studies confirm the effectiveness of each component, particularly the class-sensitive transfer and the use of lower-layer features, which enhance transfer performance and mitigate negative transfer. Additionally, CSSSTN achieves competitive results with minimal target data, reducing calibration time and effort. These findings highlight the practical potential of CSSSTN for real-world BCI applications, offering a robust and scalable solution to improve the performance of BCI-illiterate users while minimizing reliance on extensive training data. Our code is available at https://github.com/ziyuey/CSSSTN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。