arXiv:2604.07615cs.CL2026-04被引 1

自动解析语言模型内部因果图,让解释变得可复现。

ADAG: Automatically Describing Attribution Graphs

  • 用梯度效应量化特征功能,构建可计算的归因画像。
  • 通过聚类与大模型生成自然语言解释,实现端到端描述。
  • 能发现有害指令绕过漏洞的可操控特征群,适合安全研究者。

在语言模型可解释性研究中,电路追踪旨在识别哪些内部特征对特定输出具有因果影响,以及它们如何相互作用,以揭示行为背后的计算机制。然而,以往所有工作都依赖人工对电路中每个特征的作用进行主观解读,通常通过手动检查数据样本等可视化结果。本文提出ADAG,一个完全自动化的归因图描述端到端流程。为此,我们引入了‘归因画像’,通过输入和输出梯度效应量化特征的功能角色;设计了一种新型聚类算法对特征进行分组;并采用大模型解释器-模拟器架构,生成并评估这些特征组的功能性自然语言解释。我们在已知的人工分析电路追踪任务上运行系统,成功恢复出可解释的电路结构,并进一步证明ADAG可发现导致Llama 3.1 8B Instruct模型产生有害建议的可操控特征群。

原文摘要 · Abstract (English)

In language model interpretability research, \textbf{circuit tracing} aims to identify which internal features causally contributed to a particular output and how they affected each other, with the goal of explaining the computations underlying some behaviour. However, all prior circuit tracing work has relied on ad-hoc human interpretation of the role that each feature in the circuit plays, via manual inspection of data artifacts such as the dataset examples the component activates on. We introduce \textbf{ADAG}, an end-to-end pipeline for describing these attribution graphs which is fully automated. To achieve this, we introduce \textit{attribution profiles} which quantify the functional role of a feature via its input and output gradient effects. We then introduce a novel clustering algorithm for grouping features, and an LLM explainer--simulator setup which generates and scores natural-language explanations of the functional role of these feature groups. We run our system on known human-analysed circuit-tracing tasks and recover interpretable circuits, and further show ADAG can find steerable clusters which are responsible for a harmful advice jailbreak in Llama 3.1 8B Instruct.

模型解释因果追踪归因分析大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。