用局部三角图追踪语言模型隐状态,揭示词义感知机制。
RSD: Moving Local Triangular Charts for Auditing Language-Model Hidden States
- 构建共享三锚点图表,动态分析隐藏状态的语义关系。
- 在WiC数据集上覆盖53个目标词中的16个,识别出词义对齐模式。
- 适合研究模型内部语义表征与错误根源的开发者使用。
我们研究关系语义分解(RSD),将其作为语言模型隐藏状态的移动局部三角图审计方法。针对同一目标词的重复出现,在层或标记时间t处拟合一个共享的三锚点成员图$S_t$。隐藏状态通道使用$X_t\approx S_tC_t$;不变读出$M_t=S_tS_t^\top$为诱导的共成员关系,$R_t=X_t-S_tC_t$记录拟合根图未包含的部分。更广泛的联合审计复用相同成员图处理关系数据,如注意力导出的出现关系$A_t\approx S_tB_tS_t^\top$。当前基于GPT-2的证据采用词境标签作为同义/异义参考关系进行$X$通道隐藏状态审计。在完整WiC训练集上,根图通过了53个可选目标词中的16个,此为审计覆盖率,非模型任务准确率。标记时间与成对诊断显示主要模式: exttt{make}和 exttt{break}在目标状态对齐, exttt{drive}和 exttt{stay}在小样本探索中右文后改善,而 exttt{play}始终是局部根图失败案例,其最终同义对距离更远且残差更大。结论为诊断性:RSD报告语义关系在根共成员中的可见性,以及哪些失败成为残差分支候选或注意力通道责任。
原文摘要 · Abstract (English)
We study Relational Semantic Decomposition, abbreviated as RSD, as a moving local triangular chart audit for language-model hidden states. For repeated occurrences of one target word, RSD fits a shared three-anchor membership chart $S_t$ at layer or token-time $t$. The hidden-state channel uses $X_t\approx S_tC_t$; the invariant readout $M_t=S_tS_t^\top$ is the induced occurrence co-membership relation, and $R_t=X_t-S_tC_t$ records what the fitted root chart leaves outside the chart. The broader joint audit reuses the same membership chart for relation data, $A_t\approx S_tB_tS_t^\top$, such as an attention-derived occurrence relation. The current GPT-2 evidence is the $X$-channel hidden-state audit with Word-in-Context labels used as an external same-sense versus different-sense reference relation. On full WiC train, the root chart passes 16 of 53 eligible target words; this is audit coverage, not GPT-2 task accuracy. Token-time and pair-level diagnostics show the main regimes: \texttt{make} and \texttt{break} align at the target state, \texttt{drive} and \texttt{stay} improve after right context in small-count exploratory cases, and \texttt{play} remains a localized root-chart failure whose final same-sense pairs are not closer and have larger residual discrepancy. The resulting claim is diagnostic: RSD reports where a sense relation is visible in root co-membership and which failures become residual branch candidates or attention-channel obligations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。