提出HETA方法,让自回归大模型的生成过程更可解释。
Hessian-Enhanced Token Attribution (HETA): Interpreting Autoregressive LLMs
- 结合语义传递向量、海森敏感度与KL散度,捕捉生成中的因果关系。
- 在多个模型和数据集上,对齐人类标注效果优于现有方法。
- 专为解码器模型设计,适合研究大模型可解释性的人参考。
归因方法旨在通过量化输入标记对生成输出的贡献来解释语言模型的预测。然而,大多数现有技术针对编码器架构设计,依赖线性近似,无法捕捉解码器仅模型自回归生成中的因果与语义复杂性。为此,我们提出面向解码器仅语言模型的新型归因框架HETA。HETA融合三个互补组件:捕捉跨层词元间影响的语义过渡向量、建模二阶效应的海森敏感度分数,以及衡量标记掩码时信息损失的KL散度。该统一设计生成上下文感知、因果忠实且语义扎根的归因结果。此外,我们引入一个精心构建的基准数据集,用于系统评估生成场景下的归因质量。在多个模型与数据集上的实证评估表明,HETA在归因忠实性和与人类标注的一致性方面持续优于现有方法,确立了自回归语言模型可解释性的新标准。
原文摘要 · Abstract (English)
Attribution methods seek to explain language model predictions by quantifying the contribution of input tokens to generated outputs. However, most existing techniques are designed for encoder-based architectures and rely on linear approximations that fail to capture the causal and semantic complexities of autoregressive generation in decoder-only models. To address these limitations, we propose Hessian-Enhanced Token Attribution (HETA), a novel attribution framework tailored for decoder-only language models. HETA combines three complementary components: a semantic transition vector that captures token-to-token influence across layers, Hessian-based sensitivity scores that model second-order effects, and KL divergence to measure information loss when tokens are masked. This unified design produces context-aware, causally faithful, and semantically grounded attributions. Additionally, we introduce a curated benchmark dataset for systematically evaluating attribution quality in generative settings. Empirical evaluations across multiple models and datasets demonstrate that HETA consistently outperforms existing methods in attribution faithfulness and alignment with human annotations, establishing a new standard for interpretability in autoregressive language models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。