arXiv:2604.23829cs.AI2026-04

将稀疏自编码器特征转化为可读的知识图谱,揭示模型内部知识结构。

Domain-Filtered Knowledge Graphs from Sparse Autoencoder Features

论文配图:Domain-Filtered Knowledge Graphs from Sparse Autoencoder Features
图 1 · 摘自论文原文
  • 通过对比激活与多阶段过滤,构建领域专属概念集合。
  • 建立共现图与转码机制图,实现跨层特征关联与多粒度结构组织。
  • 自动标注边关系,使海量特征转化为可读知识图谱,适合模型可解释性研究。

稀疏自编码器(SAEs)从语言模型中提取数百万个可解释特征,但原始特征列表缺乏结构,领域概念混杂通用特征,相关概念分散于多个单元,且无特征间关系。本文首先利用对比激活和多阶段过滤,从大规模SAE特征库中构建严格的领域特定概念集合;接着在过滤后的集合上构建两个对齐的图结构:基于语料的共现图,按多级粒度组织概念结构;以及基于转码机制的图,通过稀疏潜在路径连接源层与目标层特征。自动边标注将这些图转化为可读知识图谱,而非无标签布局。以生物学教材为例,该方法恢复了章节与子章节级别的结构,揭示相邻主题间的桥梁概念,并将包含数千个特征的句子级活动压缩为简洁可读的视图,展现模型局部活动。整体上,该方法将扁平的SAE特征库存重构为内部知识图谱,实现了从特征级可解释性到模型知识全局映射的跃迁,支持推理忠实度审计。

原文摘要 · Abstract (English)

Sparse autoencoders (SAEs) extract millions of interpretable features from a language model, but flat feature inventories aren't very useful on their own. Domain concepts get mixed with generic and weakly grounded features, while related ideas are scattered across many units, and there's no way to understand relationships between features. We address this by first constructing a strict domain-specific concept universe from a large SAE inventory using contrastive activations and a multi-stage filtering process. Next, we build two aligned graph views on the filtered set: a co-occurrence graph for corpus-level conceptual structure, organized at multiple levels of granularity, and a transcoder-based mechanism graph that links source-layer and target-layer features through sparse latent pathways. Automated edge labeling then turns these graph views into readable knowledge graphs rather than unlabeled layouts. In a case study on a biology textbook, these graphs recover coherent chapter and subchapter-level structure, reveal concepts that bridge neighboring topics, and transform messy sentence-level activity containing thousands of features into compact, readable views that illustrate the model's local activity. Taken together, this reframes a flat SAE inventory as an internal knowledge graph that converts feature-level interpretability into a global map of model knowledge and enables audits of reasoning faithfulness.

知识图谱可解释性稀疏自编码器模型结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。