arXiv:2607.28434cs.AIcs.CL2026-07

通过隐藏状态分析文本结构,揭示隐喻的深层组织机制。

Metaphor Tracer: A Theory-Informed Analysis of Hidden States

论文配图:Metaphor Tracer: A Theory-Informed Analysis of Hidden States
图 1 · 摘自论文原文
  • 用聚合与区分两个指标,无训练地评估每个词的位置功能。
  • 聚合得分稳定追踪阅读过程,在6/6工程标记和34/36临床标注中一致。
  • 适合研究语言模型内部表征、认知语言学或心理分析的交叉学者。

一个语言模型的隐藏状态如何反映单篇文本的组织结构?仅通过一次前向传播,无需训练,即可对每个词位评分两项属性:聚合度衡量该位置是否将全文整合为稳定状态;区分度衡量其他词是否在阅读过程中短暂进入其子空间——即隐喻的本源意义,运输。常数基于单一发现文本冻结;其余均为验证。聚合度并非经典的信息量或显著性度量。在三个无关模型中,随着标记重复,其意外度与注意力消耗下降,但聚合得分保持不变:该通道标记了词语在文本中的位置。这一追踪阅读过程的能力有独立真值支持:工程标记的聚合度跨越边界时完全匹配(6/6单元),精神分析师对临床转录本的标注(事先确定)在36个单元中匹配34个,且其分级增量超越词汇控制组,类型级度量无法再现此差异。迁移测试进一步确立结果形态:词性迁移能力最强的模型反而最差地理解单一话语;在基础/指令对中微调时,保有词性转移却提升忠实度。结构价值是词语在特定文本中的位置属性,而非向量本身——这是关系性而非本质主义的隐藏状态解读,实证了早于工具存在的理论。

原文摘要 · Abstract (English)

What do a language model's hidden states say about the organization of a single text? From one forward pass, without training, we score every token position on two properties. The *aggregator* measures whether the position consolidates the whole text into a stable configuration. The *differentiator*, whether other tokens are transiently carried into its subspace as the model reads: metaphor in its root sense, transport. Constants were frozen on one discovery text; every other is confirmatory. The aggregator is not, in the classic sense, an information measure, nor a measure of salience. Across three unrelated models, as a signifier repeats, its surprisal and its attention drain while its aggregator score holds: the channel marks a token's place in the text. That this tracks a reading rests on independent ground truth: an engineered register the aggregator follows across its boundaries (6/6 cells), and a psychoanalyst's marking of clinical transcripts, fixed before the instrument existed, in 34/36 cells, with a graded increment above lexical controls and dissociations no type-level measure reproduces. A transfer test gives the result its shape: the model whose token structure travels with lexical type reads the singular discourse worst, and in a matched base/instruct pair tuning raises fidelity without moving type-transfer. Structural value is a property of a token's place in *this* text, not of its vector alone: a relational rather than essentialist reading of hidden states, operationalizing theory that predated the instrument.

语言模型隐喻分析隐藏状态认知语言学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。