arXiv:2607.10248cs.CLcs.LG2026-07被引 1

发现语言模型用统一机制处理多种心理空间。

One mechanism for many mental spaces: a shared router over a value slot in language models

  • 用共享槽位+可操控路由实现多类心理空间统一建模
  • 一个子空间训练后能控制四类空间,远超随机水平
  • 适合研究认知机制与语言模型推理的学者

语言构建的语境不仅包括现实,还涵盖绘画、信念、记忆或假设等心理空间。同一实体在不同空间中可取不同值,如花在现实中为红色,但在画中为紫色。形式语义学将这些语境分立,因逻辑类型不同(模态、时间、信念、表征)。而福孔尼尔的心理空间理论则认为它们是同一建构过程。本文探究变换器语言模型如何实现此统一机制:模型采用单一路由器/槽位结构,通过可因果操控的路由(空间索引)选择读取哪个空间中的内容;一个在反事实、信念、虚构或时间空间上训练的子空间,也能有效控制其他空间,三类模型家族均显著优于随机基线。信念虽在形式语义中被视为独立类别,但未被特别分离。路由器为低秩结构,与实体身份叠加组合,作用于少数后期层头部。进一步实验表明该机制驱动推理且具可组合性:训练规则推论的子空间改变模型推理结果,却与报告输出解耦;组合空间建构器可生成新的共享槽位路由器。本文确立了跨类型通用性。附带论文将深入探讨信念,因其在哲学、心理学和语言学中的特殊地位(认识论、心智理论、命题态度表达)。

原文摘要 · Abstract (English)

Language builds discourse contexts other than the actual: a painting, a belief, a memory, a hypothetical. Each is a mental space in which the same entity can take a different value, as when a flower is red in reality but purple in a portrait. Formal semantics keeps these contexts apart because their logics differ (modal, temporal, doxastic, depictive). Fauconnier's mental-space theory, by contrast, treats them as one space-building operation. We ask which of these a transformer language model implements, and find a mechanistic version of Fauconnier's unification. The model uses one router/slot format across the inventory: a reusable value slot stores attributed content, and a causally manipulable router (the space index) selects which space is read. A subspace trained with Distributed Alignment Search to control one space type, counterfactual, belief, fictional, or temporal, also controls the others, well above a random floor, on three model families. Belief, which formal semantics marks as a distinct case, is not specially separated. The router is low-rank, composes additively with entity identity, and acts through a few late-layer heads. Two further results show the mechanism drives inference and composes: a subspace trained on a rule-derived conclusion flips what the model infers while dissociating from what it reports, and composing space-builders mints a fresh router over the shared slot. This paper establishes the cross-type generality. A companion paper develops belief in depth, because of its special status in philosophy, psychology, and linguistics (epistemology, theory of mind, and propositional attitude reports).

心理空间语言模型推理机制认知建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。