arXiv:2505.20480eess.SPcs.CL2025-05被引 1

通过分层解耦方法,从脑电数据中精准分离语音相关神经信号。

BrainStratify: Coarse-to-Fine Disentanglement of Intracranial Neural Dynamics

  • 先粗后细分层识别功能区域,再用解耦量化分离不同神经动态
  • 在三个数据集上语音解码准确率显著优于现有方法
  • 适合脑机接口、神经机制研究者参考

直接从神经活动解码语音是脑机接口的核心目标。近年来,随着立体脑电(sEEG)和皮层脑电(ECoG)等颅内场电位记录的广泛应用,取得了显著进展。这些信号虽能反映群体神经活动,但面临两大挑战:(i) 与任务相关的信号在sEEG电极中稀疏分布;(ii) 与无关信号在sEEG和ECoG中高度混杂。为此,我们提出统一的粗到精神经解耦框架BrainStratify,包含:(i) 基于空间上下文引导的时空建模识别功能组;(ii) 在目标功能组内使用解耦乘积量化(DPQ)分离不同神经动态。我们在两个开源sEEG数据集和一个(硬膜外)ECoG数据集上评估,涵盖发声和语音感知等任务。大量实验表明,BrainStratify作为统一解码框架,在跨数据集和任务上显著优于已有方法。通过结合数据驱动分层与神经科学启发的模块化设计,为颅内记录的语音解码提供了鲁棒且可解释的解决方案。

原文摘要 · Abstract (English)

Decoding speech directly from neural activity is a central goal in brain-computer interface (BCI) research. In recent years, exciting advances have been made through the growing use of intracranial field potential recordings, such as stereo-ElectroEncephaloGraphy (sEEG) and ElectroCorticoGraphy (ECoG). These neural signals capture rich population-level activity but present key challenges: (i) task-relevant neural signals are sparsely distributed across sEEG electrodes, and (ii) they are often entangled with task-irrelevant neural signals in both sEEG and ECoG. To address these challenges, we introduce a unified Coarse-to-Fine neural disentanglement framework, BrainStratify, which includes (i) identifying functional groups through spatial-context-guided temporal-spatial modeling, and (ii) disentangling distinct neural dynamics within the target functional group using Decoupled Product Quantization (DPQ). We evaluate BrainStratify on two open-source sEEG datasets and one (epidural) ECoG dataset, spanning tasks like vocal production and speech perception. Extensive experiments show that BrainStratify, as a unified framework for decoding speech from intracranial neural signals, significantly outperforms previous decoding methods. Overall, by combining data-driven stratification with neuroscience-inspired modularity, BrainStratify offers a robust and interpretable solution for speech decoding from intracranial recordings.

脑机接口语音解码神经解耦sEEG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。