arXiv:2601.20447q-bio.NCcs.AI2026-01被引 4

用脑电波直接翻译成自然语言,让意念沟通更准确可解释。

Assembling the Mind's Mosaic: Towards EEG Semantic Intent Decoding

  • 将语义拆解为可组合的单元,通过集合匹配解析脑电信号
  • 在多语言脑电和临床数据上实现高保真语句重建
  • 适合需要精准意念表达的神经接口研究者

通过脑机接口实现自然交流仍是神经科学与神经技术中最深远的挑战之一。现有方法受限于过于简化的语义表示和缺乏可解释性。为此,我们提出语义意图解码(SID)框架,通过建模意义为灵活的组合语义单元,将神经活动转化为自然语言。SID基于三个核心原则:语义组合性、语义空间的连续与可扩展性,以及重建保真度。我们构建了BrainMosaic深度学习架构实现SID:利用集合匹配从EEG/SEEG信号中解码多个语义单元,并通过语义引导重构连贯句子。该方法突破传统固定类别分类或无约束生成的局限,实现了更具可解释性和表现力的交流范式。在多语言脑电及临床SEEG数据集上的大量实验表明,SID与BrainMosaic显著优于现有框架,为自然高效的脑机通信铺平道路。

原文摘要 · Abstract (English)

Enabling natural communication through brain-computer interfaces (BCIs) remains one of the most profound challenges in neuroscience and neurotechnology. While existing frameworks offer partial solutions, they are constrained by oversimplified semantic representations and a lack of interpretability. To overcome these limitations, we introduce Semantic Intent Decoding (SID), a novel framework that translates neural activity into natural language by modeling meaning as a flexible set of compositional semantic units. SID is built on three core principles: semantic compositionality, continuity and expandability of semantic space, and fidelity in reconstruction. We present BrainMosaic, a deep learning architecture implementing SID. BrainMosaic decodes multiple semantic units from EEG/SEEG signals using set matching and then reconstructs coherent sentences through semantic-guided reconstruction. This approach moves beyond traditional pipelines that rely on fixed-class classification or unconstrained generation, enabling a more interpretable and expressive communication paradigm. Extensive experiments on multilingual EEG and clinical SEEG datasets demonstrate that SID and BrainMosaic offer substantial advantages over existing frameworks, paving the way for natural and effective BCI-mediated communication.

脑机接口语义解码脑电分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。