研究语言模型如何抵抗词语旧义干扰,发现修复特定激活可恢复推理能力。
Persistent Priors, Preserved Targets: A Stroop-Style Paradigm for Lexical Override

- 用类似斯特鲁普效应的实验设计,测试模型对词义冲突的反应。
- 修复目标词激活后,模型在冲突任务中的正确率恢复至接近原始水平。
- 适合关注模型内部机制与抗干扰能力的研究者阅读。
局部定义可临时赋予熟悉词汇新含义,而其原有语义关联仍可能在其他场景中产生干扰。我们采用匹配的斯特鲁普式范式测量这种干扰。冲突提示将'医生'定义为'森林',并比较'森林'与熟悉的'医院';中性对照则用语义弱词替换'医生',保持'森林'和'医院'不变。所有11个模型级别的均值均为正,四个冲突类别和提示格式的聚合均值也均为正。无重定义时,对熟悉干扰项的更强偏好预测了在任意语义、多义/实体及领域定义重映射中的更大干扰,而反义关系无此趋势。进一步地,在五个10亿至20亿参数模型中,将中性控制激活注入反义提示,同时修补定义词、定义中的目标词及后续查询词的激活,几乎完全恢复了冲突下损失的目标-干扰项差值(归一化恢复率R在[0.92,1.06]之间)。仅替换目标词激活为另一样本的捐赠激活,则每种情况恢复度均下降。这些捐赠修补还降低了干扰项的逻辑值,而上下文目标项下降幅度远超同样本修补。
原文摘要 · Abstract (English)
Local definitions can assign a familiar word a temporary meaning while its usual associations remain useful elsewhere. We measure interference from those associations with a matched Stroop-style paradigm. A conflict prompt defines doctor as forest and compares forest with the familiar associate hospital. A neutral control replaces doctor with a semantically weak word in both the definition and query while keeping forest and hospital fixed. All 11 model-level means are positive. Aggregate means are also positive for all four conflict families and prompt formats. When no redefinition is present, a stronger preference for the familiar distractor predicts more interference in arbitrary-semantic, polysemy/entity, and domain-definition remappings, while the antonym slope is null. Separately, we patch neutral-control activations into antonym prompts in five 1B-2B models. Patching the defined word, the target word in the definition, and the later query word together restores almost all of the target-minus-distractor margin lost in conflict (normalized recovery R in [0.92,1.06]). Replacing only that target-word activation with a donor from another item reduces recovery in every tested case. Those donor patches also lower the distractor logit, while the contextual target falls much more than under the same-item patch that restores the margin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。