arXiv:2606.12629cs.LGcs.AI2026-06

发现Transformer原始维度的符号就能检测和操控概念,无需训练。

The Signs Were Always There: Training-Free Concept Detection and Steering in Raw Transformer Dimensions

论文配图:The Signs Were Always There: Training-Free Concept Detection and Steering in Raw Transformer Dimensions
图 1 · 摘自论文原文
  • 用维度符号做二值开关,读取时仅看正负号,不依赖模型参数。
  • 单次前向传播即可检测175类概念,准确率高达0.97-0.99,且能从随机种子发现1500个特征。
  • 符号在多模态中一致,可直接操纵生成内容,适合快速可控生成与模型分析。

Transformer隐藏状态的标准基底是一种无需训练、适用于各类架构的概念检测与控制特征基;无需学习词典。每个维度像一个单一二值寄存器:符号(±1)编码内容,幅度表示强度。一个概念即是一组具有稳定符号模式的维度,通过统计符号一致性来读取。我们在七个跨语言、视觉与音频模型中验证了该袋维(BoD)框架;逐维读取不损失性能,全容量MLP对AUC提升为零。相同符号模式出现在所有模态中,反映的是变压器训练本身而非语言目标。仅符号携带预测信息:将所有幅度设为1仍保留60%-93%的top-5下一个词准确率。仅需单个词元缓存(每词元一次前向传播,无标签),即可通过符号一致性检测175个类别,AUC达0.97-0.99;仅凭随机种子即可发现每模型1500个特征。训练探测器仅带来+0.018 AUC,且收敛至轴对齐权重:旋转词典带来的收益极小。符号具有因果作用:其在注意力投影后仍存在,实时翻转符号可抑制对应概念。读取与控制功能在同一线性基中分离:概念的读取维度并非写入维度。写入目标同样低成本,仅需对少量种子的未嵌入行求和符号,无需训练。通过闭环控制注入注意力输出路径,可在四个语言模型上成功引导概念生成流畅文本(12个概念中62%-92%成功)。符号早就在标准基中;核心问题不再是寻找正确旋转,而是列出各维度所编码的内容。

原文摘要 · Abstract (English)

The standard basis of transformer hidden states is a training-free, architecture-general feature basis for detecting concepts and, in language models, steering them; with no learned dictionary. Individual dimensions act as binary registers read one at a time: their signs (+/-1) encode content, their magnitudes strength. A feature is just a subset of dimensions with a consistent sign pattern, read by counting sign agreements. We validate this Bag of Dims (BoD) framework across seven models spanning language, vision, and audio; reading dimensions one at a time loses nothing, as a full-capacity MLP adds zero AUC over per-dim reading. The same per-dimension signs appear in every modality, so they reflect transformer training itself, not the language objective. Sign alone carries predictive content: setting all magnitudes to unity preserves 60-93% top-5 next-token accuracy through the LM head. From a single-token cache (one forward pass per token, no labels) we detect 175 categories at AUC 0.97-0.99 by counting sign agreements, and from random seeds alone discovery scales to 1500 features per model. A trained probe adds only +0.018 AUC and converges to axis-aligned weights: the rotation dictionaries learn buys little. Signs are causally operative: they survive the attention projections, and flipping a concept's sign pattern in the live forward pass suppresses it. Reading and steering are separate roles in the same basis: a concept's reader dimensions are not its writer dimensions. The writer target is just as cheap, the sign of the summed unembedding rows over a few seeds, no training. Injected through the attention output pathway under closed-loop control, it steers concepts into fluent text on four language models (62-92% of twelve concepts). The signs were in the standard basis all along; the open problem is no longer finding the right rotation but cataloging what each dimension encodes.

概念检测无需训练符号控制模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。