arXiv:2605.21049cs.CL2026-05被引 1

跨语言脑-大模型对齐稳定,但非由预测误差或表征几何决定。

Cross-lingual robustness of LLM-brain alignment and its computational roots

  • 用多语言全脑框架验证三种语言下大模型对大脑活动的预测能力。
  • 模型在皮层与皮层下区域均表现良好,跨语言空间重叠度高且层间稳定。
  • 发现对齐不来自预测不确定性或信息压缩,而是词汇语义的普遍对应。

大型语言模型(LLMs)能可靠预测语言理解过程中的神经活动,且变换器深度被解释为模拟层级皮层结构。然而,这种对齐是否延伸至皮层下区域、在不同语言间是否存在空间重叠,以及其计算基础为何仍不明确。本研究采用多语言全脑编码框架,考察了中文、英文和法语三种类型差异显著的语言在自然故事聆听时的脑-模型对齐情况。结果表明,基于变换器的模型在广泛分布的皮层功能网络(如边缘系统、腹侧注意网络、默认模式网络)及皮层下结构中均能有效预测神经活动。空间对齐模式在语言间具有显著重叠,且在模型各层间保持稳定,仅有限层进展符合皮层功能层级特征。与以往发现相反,上下文嵌入并未优于静态嵌入。为检验潜在计算机制,我们考察了层间脑评分是否反映意外性(surprisal)和内在维度(intrinsic dimensionality),即预测加工与信息压缩。两者均未匹配神经对齐模式。研究提示,脑-模型对齐具有空间鲁棒性和跨语言稳定性,但无法由预测不确定性或表征几何解释。神经可预测性更可能源于跨语言泛化的分布式词汇语义对应关系。

原文摘要 · Abstract (English)

Large language models (LLMs) reliably predict neural activity during language comprehension and transformer depth has been interpreted as mirroring hierarchical cortical organization. However, it remains unclear whether such alignment extends to subcortical regions, overlaps spatially across languages, and what the computational roots of such alignment are. Here, we used a multilingual, whole-brain encoding framework to examine brain-LLM alignment across three typologically distinct languages: Mandarin, English, and French during naturalistic story listening. Our results show that across languages, transformer-based models predicted activity in a distributed landscape spanning widely distributed cortical functional networks like limbic, ventral attention, default mode network, and subcortical structures. Spatial alignment patterns showed substantial cross-linguistic overlap and remained largely stable across model layers, with limited layer progression consistent with functional cortical hierarchies. Contrary to previous evidence, contextual embeddings did not outperform static embeddings. To test candidate computational explanations, we examined whether layer-wise brain scores reflect surprisal and intrinsic dimensionality, and thereby predictive processing and information compression. Neither of these two computational metrics mirrored neural alignment profiles. Our findings suggest that brain-LLM alignment is spatially robust and cross-linguistically stable but not explainable from predictive uncertainty or representational geometry. Rather than directly reflecting shared hierarchical computation, neural predictivity may primarily arise from distributed lexical-semantic correspondences that generalize across languages.

脑机对齐跨语言大模型神经科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。