arXiv:2608.11656cs.LG2026-08

用连续语义预测提升脑电与语言模型的对齐效果

Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models

论文配图:Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models
图 1 · 摘自论文原文
  • 将脑电解码转为连续语义嵌入预测,避免离散令牌错配
  • 通过潜在目标预测学习可迁移的脑电表征,跨任务泛化性能提升
  • 适合脑机接口、神经语言建模研究者,推动跨模态理解

近期脑电基础模型进展表明,大规模预训练可实现跨被试、跨环境、跨数据集的通用神经解码。然而主流预训练范式存在关键挑战:掩码自编码倾向于优先重建低层信号而非任务相关语义;自回归建模则造成连续神经动态与离散标记空间之间的不匹配。为此,我们提出脑潜空间预测模型(BLPM),将异构脑电解码任务重新定义为连续语义嵌入预测问题。BLPM引入连续脑电潜空间预测(CELP)编码器,通过潜在目标预测学习可迁移表征。在此基础上,多查询语义分解(MQSD)模块提取任务相关信息,并根据语义关系在共享潜空间中对齐连续脑电表征与文本语义。多个基准测试结果表明,该模型在多样化任务中均实现一致的泛化性能,确立了连续潜语义预测作为脑电-语言基础模型的有效范式。

原文摘要 · Abstract (English)

Recent advances in EEG foundation models have demonstrated the potential of large-scale pretraining to enable generalizable neural decoding across subjects, recording environments, and datasets. However, dominant pretraining paradigms face key challenges: masked autoencoding tends to prioritize low-level signal reconstruction over task-relevant semantics, while autoregressive modeling creates a mismatch between continuous neural dynamics and discrete token spaces. To address these challenges, new strategies are needed to effectively align continuous EEG representations with natural-language semantics and enable their integration with large language models. Accordingly, we propose Brain Latent Predictive Model (BLPM), an EEG-language foundation model that reformulates heterogeneous EEG decoding tasks as a continuous semantic embedding prediction problem. BLPM introduces a Continuous EEG Latent Predictive (CELP) encoder that learns transferable representations through latent target prediction. Building on these representations, a Multi-Query Semantic Decomposition (MQSD) module extracts task-relevant information and aligns continuous EEG representations with textual semantics within a shared latent space according to their semantic relationships. Experiments across multiple benchmarks demonstrate consistent generalization performance across diverse tasks, establishing continuous latent semantic prediction as an effective paradigm for EEG-language foundation models.

脑电建模语义对齐基础模型连续潜空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。