语言模型通过路由机制分离角色信念与现实,无需标签即可精准区分。
Belief-reality separation lives in routing over a shared value slot in language models
- 用共享值槽+查询位置路由实现信念与现实的分离
- 3B至7B模型间出现该能力,跨五类架构稳定存在
- 适合研究认知建模或推理机制的读者
强大的语言模型能够区分角色信念与真实情况:当被告知‘安娜认为杯子是蓝色的;实际上它是红色的’时,模型对安娜的回答为蓝色,对世界的真实情况回答为红色。这种分离机制存在于计算过程中的两个可分环节:一个通用值槽用于绑定属性值,而位于查询位置的路由器则决定查询读取的是角色信念还是现实。两种路径填充该槽:直接注入的声明性信念,以及通过可见性门控回溯推断出的推导性信念。训练中任一路径的子空间能调控另一路径,仅推导路径依赖描述的可见性。值槽本身不携带信念-现实标签,干预它会同等影响信念和现实读取。真正的分离存在于一对解耦的路由子空间,它们在不注入源值的情况下切换查询框架。该现象在三类架构中均成立,且在去混淆理论心智基准测试的刺激下依然有效;该行为在五类模型家族中于3B到7B参数规模间自然涌现。本文深入剖析单一信念-现实轴线,配套论文表明相同槽-路由结构也适用于其他非真实语境(如反事实、虚构、时间状态)。
原文摘要 · Abstract (English)
Capable language models hold what a character believes apart from what is true: told "Anna believes the cup is blue; in reality it is red," they answer blue about Anna and red about the world. Where in the computation does that separation live? We show it rests on two separable mechanisms at two positions. A generic value slot binds the attributed value. A router at the query position selects which frame, the character's belief or reality, a query reads out. Two routes fill the slot: an asserted belief, whose value the text supplies, binds in directly; a derived belief, whose value must be inferred from what the character could see, arrives by a visibility-gated lookback. A subspace trained on either route steers the other, and only the derived route depends on described visibility. The slot itself carries no belief-reality tag: intervening on it moves a reality readout as strongly as a belief one. The separation lives instead in a dissociated pair of routing subspaces, which flip a query between frames without injecting the donor's value. These results hold across three architectures, on stimuli de-confounded against theory-of-mind-benchmark shortcuts; the behavior itself emerges between 3B and 7B across five model families. This paper develops the single belief-reality axis in depth; a companion paper shows the same slot-and-router format is shared across the other non-actual contexts a sentence can open (counterfactual, fictional, temporal).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。