arXiv:2605.24524cs.LGcs.CL2026-05被引 1

揭示脑语言解码中性能虚高的根源,区分信号与干扰因素。

What Are We Actually Decoding? Source Attribution for Non-Invasive Brain-to-Language Retrieval

论文配图:What Are We Actually Decoding? Source Attribution for Non-Invasive Brain-to-Language Retrieval
图 1 · 摘自论文原文
  • 构建审计框架,分离解码性能的三类来源:结构捷径、窗口内刺激证据、跨窗口上下文聚合。
  • 固定窗口下脑电数据仍具可区分性,但95.7%最高分错误源于句级竞争。
  • 提出GCB方法量化上下文影响,验证其可归因性,适合严谨评估研究者使用。

在非侵入式神经语言解码中,性能提升可能源于非刺激诱发的来源:解码器先验、基于嵌入的度量方式,以及信号持续时间等非神经结构干扰。核心挑战在于归因:性能增益若能追溯到具体来源,则更具信息量。本文将刺激锁定的MEG-to-audio检索重构为审计框架,将表观性能拆分为三类:结构捷径、窗口级刺激锁定证据、跨窗口上下文聚合,并提供每类的诊断手段。在无信号噪声条件下,可变长度解码时Rank@1达66.3%,但强制固定时长窗口与刺激身份划分后,性能降至接近随机水平,揭示了结构泄漏。在此控制下,固定窗口检索恢复了可测量的MEG-audio可区分性;通过真值句桶诊断发现,95.7%的Top-1错误选择了错误句子,定位残余瓶颈在句级竞争。进一步使用组上下文偏差(GCB)——一种推理时的对数偏置,聚合跨窗口一致证据——作为分数空间干预,使上下文源可测量:在Gwilliams上R@1从44%升至52%,在MOUS上从22%升至29%,均在相同固定设置下。GCB具备可审计性:随机分组扰动下效应消失,且当MEG局部证据减弱或EEG表现接近随机时亦失效,支持其作为受控归因干预的有效性。结果表明,脑语言解码性能应进行源归因,而非简单报告。

原文摘要 · Abstract (English)

In non-invasive neural language decoding, results can be inflated by sources that are not stimulus-evoked neural evidence: decoder priors, embedding-based metrics, and non-neural structural nuisances such as signal duration. The methodological challenge is therefore attribution: a reported gain is more informative when it can be traced to a specific source. We recast stimulus-locked MEG-to-audio retrieval as an auditing framework that separates apparent performance into three sources - structural shortcuts, window-level stimulus-locked evidence, and cross-window contextual aggregation - and provides a diagnostic for each. Signal-blind Gaussian noise reaches 66.3% Rank@1 (R@1) under variable-length decoding but collapses to near chance once fixed-duration windows and stimulus-identity splits are enforced, isolating structural leakage. Under these controls, fixed-window retrieval recovers measurable MEG-audio discriminability, while an oracle sentence-bucket diagnostic shows that 95.7% of Top-1 errors select the wrong sentence, localising the residual bottleneck to sentence-level competition. We audit this contextual source with Group Context Bias (GCB), an inference-time additive logit bias that pools sentence-consistent evidence across windows while leaving the base retrieval scores and candidate pool fixed. Used as a score-space intervention, GCB makes the contextual source measurable: R@1 shifts from 44% to 52% on Gwilliams and from 22% to 29% on MOUS under the same fixed setting. GCB is auditable under this design: its effect collapses under random-grouping perturbations and vanishes when local evidence is attenuated in MEG or is near chance in EEG, supporting its use as a controlled source-attribution intervention. These results suggest that brain-to-language performance should be source-attributed, not merely reported.

脑机接口解码归因语音生成神经审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。