用大模型引导小模型,实现无源跨被试脑电解码
Foundation Model Guided Dual-Branch Co-Adaptation for Source-Free EEG Decoding

- 双分支协同适应,大模型与小模型互相生成伪标签
- 通过共识筛选和两阶段伪标签优化,提升标签可靠性
- 首次在无源脑电适配中引入脑电大模型,兼顾隐私与性能
无源域适应(SFDA)通过将预训练模型适配到未标注的目标域,在不访问源数据的情况下实现跨被试脑电信号解码。现有方法仅依赖源模型内部知识,导致泛化能力差且伪标签不可靠。尽管大规模脑电基础模型(EEG FMs)具备强泛化能力,其在SFDA中的潜力仍待探索。为此,我们提出FUSED框架,通过双分支协同适应将大模型与小型专业模型(SM)结合。具体地,设计了包含线性与原型视角的协同适应机制,支持跨分支伪标签生成;提出共识过滤机制,利用大模型的稳定性识别高质量样本;并设计两阶段伪标签精炼方案,通过跨分支仲裁抑制错误累积。最后,通过最大化大模型与小模型间的互信息来校准决策边界,并进行从大模型到小模型的知识蒸馏,形成先校准后蒸馏的流程。据我们所知,FUSED是首个在SFDA框架中引入脑电基础模型的跨被试脑电解码工作。在三种脑电范式(运动想象、情绪识别、稳态视觉诱发电位)上的实验均达到当前最优性能,验证了基础模型引导协同的有效性。
原文摘要 · Abstract (English)
Source-free domain adaptation (SFDA) provides a practical solution to cross-subject EEG decoding by adapting source-pretrained models to unlabeled target domains without accessing source data. However, existing SFDA methods rely solely on the limited internal knowledge of source-pretrained models, leading to inferior cross-domain generalization and unreliable pseudo-labels. Although EEG Foundation Models (FMs) pretrained on large-scale data exhibit strong generalizability, their potential in SFDA remains largely unexplored. To this end, we propose FUSED, a Foundation-guided Source-free EEG Decoding framework that integrates a large-scale FM with a compact Specialist Model (SM) via dual-branch co-adaptation. Specifically, we introduce a Co-adaptation mechanism equipping both branches with linear and prototype views, enabling cross-branch pseudo-label generation. Additionally, we design a Consensus Filtering Mechanism that exploits the FM's inherent stability to identify high-quality samples, along with a Two-Stage Pseudo-Label Refinement scheme to suppress error accumulation through cross-branch arbitration. Finally, we calibrate the FM's decision boundaries via mutual information maximization with the SM, followed by knowledge distillation from FM to SM, forming a principled calibrate-then-distill pipeline. To our knowledge, FUSED is the first work to leverage EEG FMs within the SFDA framework for cross-subject EEG decoding. Extensive experiments across three EEG paradigms, including motor imagery, emotion recognition, and SSVEP, demonstrate consistent state-of-the-art performance, validating the effectiveness of foundation-guided synergy for robust and privacy-preserving EEG decoding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。