发现语义关联性比预期意外度更能解释自然语言听觉中的脑活动。
Contextual Semantic Relevance Tracks fMRI BOLD Responses During Naturalistic Speech Comprehension

- 用语义关联性衡量词与上下文的契合度,独立于传统预测因素。
- 在两个数据集中,语义关联性均显著影响大脑血氧信号,尤其在听觉任务中更突出。
- 前额叶正向响应,后部语义区负向响应,揭示不同神经机制分工。
自然语言理解需处理局部概率预期与上下文语义关系。本研究检验了语义关联性(目标词与其近期语义背景的强弱关系)是否在控制词意外度及词汇、时间、声学、语调等因素后,仍与fMRI BOLD信号相关。分析了两个公开数据集:Alice(23人,1个叙事)和Narratives(47人,185次运行,4个故事),采用FIR/去卷积和广义加性混合模型(GAMMs)。在Alice中,语义关联性在所有感兴趣区域(ROIs)中均为显著,而意外度不显著;在GAMMs中,两者均广泛显著。在Narratives中,两者在各脑区分布相近。语义关联性在两数据集中均表现出稳健的BOLD关联,尤其在对时间敏感的Alice FIR分析中优于意外度。语义关联效应在脑区间呈现异质方向:后部语义区为负,前额整合区为正,提示功能分离的神经过程而非单一机制。结果表明,语义契合度与局部概率预期对自然听觉中的血流动力学反应有部分独立且依赖数据集的贡献。
原文摘要 · Abstract (English)
Naturalistic language comprehension requires listeners to process both local probabilistic expectations and contextual semantic relations. This study tested whether contextual semantic relevance, measuring how strongly a target word relates to its recent semantic context, is associated with fMRI BOLD responses independently of word surprisal and lexical, timing, acoustic, and prosodic controls. We analyzed two public datasets: Alice (23 participants, one narrative) and Narratives (47 participants, 185 runs, four stories) using FIR/deconvolution and generalized additive mixed models. In Alice, semantic relevance was significant across all ROIs in FIR analyses, whereas surprisal was not. In GAMMs, both predictors showed broad significance. In Narratives, both predictors showed comparable spatial prevalence across ROIs. Semantic relevance showed robust BOLD associations across both datasets, with a particularly strong advantage over surprisal in the timing-sensitive Alice FIR analysis. The regionally heterogeneous direction of semantic relevance effects, with negative effects in posterior semantic regions and positive effects in frontal integration regions, suggests involvement of functionally distinct neural processes rather than a single uniform mechanism. These findings indicate that contextual semantic fit and local probabilistic expectation make partially distinct, dataset-dependent contributions to hemodynamic responses during naturalistic listening.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。