用首个词提示,让冻结模型自动补全多词概念。
The First Token Is a Clue: Verbalizing Multi-Token Concepts from the J-lens

- 以首词为线索,利用冻结模型补全多词概念
- 在双词任务中补全准确率达88.3%
- 可直接用于概念替换干预,成功率61.4%
Jacobian Lens(J-lens)是用于解释大语言模型的新工具,能将隐藏状态读作词汇表的排序列表,但缺乏对多词概念的独立表示。原版J-lens通过模板镜像(Template Lens)和预言镜像(Oracle Lens)解决此问题,前者预计算固定短语向量,后者微调组件以提出短语并重建向量。本文探索是否可直接从J-lens和冻结模型中恢复多词概念及其向量。研究发现:多词概念的第一个词与单个词一样可读。给定正确首词和源提示,冻结模型在88.3%的双词案例中能恢复第二个词。我们证明,完整概念的向量可通过一次前向传播从后续隐藏状态中恢复。因此,使用J-lens提议首词,让冻结模型完成候选概念,并恢复其向量进行评分。在Gemma-3-12B-IT、Llama-3.1-8B和Qwen3-14B上的496个多跳填空任务中,该方法平均$ ext{Rank@}10$达43.1%,高于模板镜像的27.6%。若无首词线索,性能降至21.6%,表明首词线索显著提升读出效果。使用恢复向量进行因果概念替换,平均$ ext{succ}@10$达61.4%,远超模板镜像的26.2%。结果表明,首词线索可引导多词概念恢复,后续隐藏状态提供读出与干预所需的向量。
原文摘要 · Abstract (English)
The Jacobian Lens (J-lens) is a recent tool for interpreting LLMs. It reads a hidden state as a ranked list of vocabulary tokens, leaving multi-token concepts without a representation of their own. The original J-lens work addresses this limitation with Template Lens, which precomputes vectors for a fixed phrase vocabulary, and Oracle Lens, which fine-tunes components to propose phrases and reconstruct phrase vectors. We ask whether multi-token concepts and their vectors can instead be recovered directly from J-lens and the frozen model. We find that the first token of a multi-token concept is about as readable as a single-token concept. Given the correct first token and source prompt, the frozen model recovers the second token in 88.3% of two-token cases. We show that a vector for the complete concept can be recovered from subsequent hidden states in a single forward pass. We therefore use J-lens to propose first tokens and let the frozen model complete candidate concepts. We then recover a vector for each candidate and score it alongside the complete vocabulary. Across 496 multi-hop clozes on Gemma-3-12B-IT, Llama-3.1-8B, and Qwen3-14B, our method achieves an average $\mathrm{Rank@}10$ of 43.1%, compared with 27.6% for Template Lens. Without the J-lens clue, performance drops to 21.6%, showing that the first-token clue substantially improves readout. Causal concept swaps using the recovered vectors achieve an average $\mathrm{succ}@10$ of 61.4%, compared with 26.2% for Template Lens under the same intervention. These results show that first-token clues can guide multi-token concept recovery, while subsequent hidden states provide vectors for readout and intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。