arXiv:2607.01002cs.CLcs.AI2026-07

提出新方法定位大模型非字面检索的注意力头,突破传统检测局限。

Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads

论文配图:Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads
图 1 · 摘自论文原文
  • 基于输出值电路投影设计写入感知的评分机制,捕捉非字面信息整合
  • 在三个模型上,仅删50个高分头就使ROUGE-L降至0.000,远超基线
  • 适用于理解长上下文推理机制,适合模型可解释性研究者

在长上下文任务中,大语言模型常通过语义合成而非直接复制内容生成答案。现有检测方法因依赖字面匹配准则,无法识别执行此合成的注意力头。本文提出写入感知的Logit-Contribution Scoring(LOCOS),通过单次前向传播,对比关键与非关键位置的输出值投影方向,识别负责非字面检索的头。在Qwen3、Gemma-3、OLMo-3.1三个模型家族上验证,对NoLiMa基准进行均值消融时,使用LOCOS选出的头部数量更少即导致ROUGE-L显著下降:Qwen3-8B删50个头后ROUGE-L从0.401降至0.000,而最强基线仍保持0.292。所选头具检索特异性,参数记忆与算术推理性能不变。同一消融还使MuSiQue从0.55降至0.08,BABILong从0.62降至0.20,随机头对照组变化不超过0.05。

原文摘要 · Abstract (English)

In long-context use, large language models frequently synthesize answers from the meaning of a relevant context span rather than literally copy-pasting them. Identifying which attention heads perform this synthesis matters for interpreting long-context model behavior. Yet existing detectors miss these heads by construction: they reward heads whose attended token matches the generated token, a literal-copy criterion that captures where a head reads but not what it writes through its output-value (OV) circuit, the very mechanism that carries non-literal retrieval. We introduce Logit-Contribution Scoring (LOCOS), a write-aware detector that scores each head by the projection of its OV-circuit output onto the answer-token unembedding direction, contrasting needle and off-needle source positions in a single forward pass. Across three model families (Qwen3, Gemma-3, OLMo-3.1), mean-ablating the top LOCOS heads on the NoLiMa non-literal retrieval benchmark collapses ROUGE-L at lower head counts than prior attention-based detections; on Qwen3-8B, ablating 50 heads drives ROUGE-L from 0.401 to 0.000 while the strongest baseline still retains 0.292. The selected heads are retrieval-specific: parametric recall and arithmetic reasoning stay at baseline under the same ablation. On Qwen3-8B, the same ablation also drops MuSiQue from 0.55 to 0.08 and BABI-Long from 0.62 to 0.20, while a random-heads control stays within 0.05 of baseline.

模型解释注意力机制非字面检索可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。