arXiv:2605.22902cs.LGcs.AI2026-05

用可解释的计算路径分析视觉语言模型如何生成文本并识别幻觉。

Transcoders Trace Visual Grounding and Hallucinations in Vision-Language Models

论文配图:Transcoders Trace Visual Grounding and Hallucinations in Vision-Language Models
图 1 · 摘自论文原文
  • 基于Transcoder构建功能中心框架,追踪图像到文本的动态计算路径。
  • 在图像块消融下,其定位准确率高于传统方法,与语义相关区域更匹配。
  • 通过电路痕迹提取特征,可预测幻觉生成,AUC达0.68,适合模型调试者使用。

生成式视觉语言模型(VLMs)在多模态推理上表现优异,但视觉输入如何转化为文本仍不清晰。现有可解释性研究依赖稀疏自编码器(SAEs),仅分解静态残差表示,忽略驱动跨模态交互的功能更新。本文采用以功能为中心的框架,基于Transcoder——MLP子层的稀疏近似,作为逐层计算的因果代理。应用于Gemma 3-4B-IT模型,该框架将模型分解为可解释的计算路径,连接图像块与文本生成方向。与SAE相比,Transcoder归因在图像块消融时对视觉相关词汇产生更强且更稳定的扰动,并更好对齐语义相关图像区域。虚假视觉对齐反事实分析证实,恢复路径确实特异于视觉-语言交互。最后,通过对Transcoder生成的电路痕迹进行结构分析,提取基于图的指标,利用逻辑回归分类器在这些机制性特征上预测幻觉生成,达到AUC 0.68。结果表明,功能中心的电路分解能提供可解释且具预测性的多模态计算分析。

原文摘要 · Abstract (English)

Generative Vision-Language Models (VLMs) perform well on multimodal reasoning, but how visual inputs are transformed to text remains poorly understood. Existing interpretability work on VLMs uses Sparse Autoencoders (SAEs), which decompose static residual representations and miss the functional updates that drive cross-modal interaction. We adopt a function-centric framework based on Transcoders, sparse approximations of MLP sublayers that act as a causal proxy for layer-wise computation. Applied to Gemma 3-4B-IT, the framework decomposes the model into interpretable computational pathways linking image patches to directions in token generation. Transcoder attributions produce stronger and more stable effects on visually grounded tokens under patch ablation than SAE attributions, and align better with semantically relevant image regions. A False Visual Grounding counterfactual analysis confirms that the recovered pathways are specific to vision-language interaction.Finally, we perform a structural analysis of hallucinated generations, by extracting graph-based indicators from circuit traces produced by the transcoders. A logistic classifier over these mechanistic graph features predicts hallucinations at AUC $0.68$. These results show that function-centric circuit decomposition yields interpretable and predictive accounts of multimodal computation in VLMs.

视觉语言模型可解释性幻觉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。