arXiv:2604.16370cs.CLcs.AI2026-04

用语义压缩思想,从脑电波中恢复句子关键信息。

Brain-CLIPLM: Semantic Compression for EEG-to-Text Decoding

论文配图:Brain-CLIPLM: Semantic Compression for EEG-to-Text Decoding
图 1 · 摘自论文原文
  • 先提取脑电信号中的语义锚点,再基于锚点重构句子。
  • 在ZuCo数据集上达到85%的顶级25句检索准确率。
  • 适合研究脑机接口与自然语言生成的学者参考。

从非侵入式脑电图(EEG)解码自然语言仍受限于低信噪比和有限的信息带宽。本文提出语义压缩假说:非侵入式EEG可能仅保留可恢复的语义锚点,而非完整的词汇-句法结构。为此,我们提出Brain-CLIPLM框架,分两阶段进行:第一阶段通过对比学习将词级EEG信号与固定关键词库对齐,恢复有序语义锚点;第二阶段使用基于检索的大语言模型,结合思维链提示,从锚点重构句子语义。该方法遵循粒度匹配原则,使解码复杂度与可恢复神经信息尺度一致。在综合的苏黎世认知语言处理(ZuCo)基准上,该模型实现67.6%的Top-5和85.0%的Top-25句子检索准确率,且在中等锚点粒度下表现最优。控制分析表明,EEG锚点携带超出语言模型先验的句子特异性信息。结果表明,在固定关键词库与受限句子池条件下,EEG到文本的解码应视为先恢复压缩语义内容,再引导重构句子。

原文摘要 · Abstract (English)

Decoding natural language from non-invasive electroencephalography (EEG) remains constrained by low signal-to-noise ratio and limited information bandwidth. This raises a central question: can sentence-level language be reliably recovered from such signals? Under realistic information constraints, this direct-recovery assumption may be too strong. We introduce a semantic compression hypothesis: non-invasive EEG may preserve recoverable semantic anchors rather than the full lexical--syntactic form of a sentence. From this perspective, direct sentence reconstruction is overly fine-grained relative to the recoverable information scale of EEG. To address this mismatch, we propose Brain-CLIPLM, a two-stage framework that decomposes EEG-to-text decoding into semantic-anchor recovery and anchor-guided sentence reconstruction. Stage 1 uses contrastive learning to align word-level EEG evidence with a fixed keyword vocabulary and recover ordered semantic anchors. Stage 2 uses a retrieval-grounded large language model with chain-of-thought reasoning prompts to reconstruct sentence meaning from these anchors, following a granularity matching principle that aligns decoding complexity with the recoverable neural information scale. On the combined Zurich Cognitive Language Processing (ZuCo) benchmark, Brain-CLIPLM achieves 67.6\% Top-5 and 85.0\% Top-25 sentence retrieval accuracy, with the strongest performance at intermediate anchor granularity. Control analyses show that EEG-derived anchors carry sentence-specific information beyond language-model priors. Within the constrained ZuCo sentence pool and fixed keyword-vocabulary settings, these findings suggest that EEG-to-text decoding is better framed as recovering compressed semantic content before anchor-guided sentence reconstruction.

脑机接口语义解码大模型脑电图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。