arXiv:2603.17109cs.LG2026-03中稿 · ACM International …

无需微调大模型,用本地提取语义关键词实现高效隐私保护的脑电转文本。

SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrieval

  • 分两阶段解码:本地提取脑电信号的关键词,再用现成大模型生成文本。
  • 仅600万参数,128通道数据上性能超全微调模型,计算开销大幅降低。
  • 原始脑电全程本地处理,只传抽象语义,适合医疗与隐私敏感场景。

将脑活动解码为自然语言是人工智能的重要挑战,广泛应用于辅助沟通、神经技术与人机交互。现有脑机接口(BCI)多依赖在原始脑电(EEG)上对大语言模型(LLM)或编码器-解码器模型进行高内存消耗的微调,导致训练成本高、可及性差且存在神经数据泄露风险。本文提出SENSE(SEmantic Neural Sparse Extraction),一种轻量级、隐私保护的框架,可在不微调LLM的前提下实现非侵入式脑电到文本的转换。SENSE将解码过程分为两个阶段:设备端语义检索与基于提示的语言生成。脑电信号在本地映射至离散文本空间,提取非敏感的词袋(BoW),作为条件输入现成的LLM以零样本方式生成流畅文本。该模块仅含约600万参数,完全在设备端运行,确保原始神经信号始终本地化,仅抽象语义特征与语言模型交互。在128通道的脑电数据集上对六名受试者评估,SENSE在生成质量上达到或超过完全微调的基线方法(如Thought2Text),同时显著降低计算开销。通过本地化神经解码并仅共享衍生语义线索,SENSE为下一代脑机接口提供了一种可扩展、隐私友好的检索增强架构。

原文摘要 · Abstract (English)

Decoding brain activity into natural language is a major challenge in AI with important applications in assistive communication, neurotechnology, and human-computer interaction. Most existing Brain-Computer Interface (BCI) approaches rely on memory-intensive fine-tuning of Large Language Models (LLMs) or encoder-decoder models on raw EEG signals, resulting in expensive training pipelines, limited accessibility, and potential exposure of sensitive neural data. We introduce SENSE (SEmantic Neural Sparse Extraction), a lightweight and privacy-preserving framework that translates non-invasive electroencephalography (EEG) into text without LLM fine-tuning. SENSE decouples decoding into two stages: on-device semantic retrieval and prompt-based language generation. EEG signals are locally mapped to a discrete textual space to extract a non-sensitive Bag-of-Words (BoW), which conditions an off-the-shelf LLM to synthesize fluent text in a zero-shot manner. The EEG-to-keyword module contains only ~6M parameters and runs fully on-device, ensuring raw neural signals remain local while only abstract semantic cues interact with language models. Evaluated on a 128-channel EEG dataset across six subjects, SENSE matches or surpasses the generative quality of fully fine-tuned baselines such as Thought2Text while substantially reducing computational overhead. By localizing neural decoding and sharing only derived textual cues, SENSE provides a scalable and privacy-aware retrieval-augmented architecture for next-generation BCIs.

脑机接口隐私保护轻量化文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。