arXiv:2605.12809cs.LGcs.AI2026-05

提出新方法精准定位大模型决策中关键的输入词元,提升医疗等高风险场景可信度。

Correcting Influence: Unboxing LLM Outputs with Orthogonal Latent Spaces

论文配图:Correcting Influence: Unboxing LLM Outputs with Orthogonal Latent Spaces
图 1 · 摘自论文原文
  • 用稀疏自编码器学习独立潜在特征,通过雅可比向量积计算非可加性影响
  • 在医疗数据集上识别出少量、可解释的关键词元组合,显著提升预测可追溯性
  • 适合需透明决策的医疗AI审计,支持非自回归任务的通用分析

大语言模型在医疗领域的可靠应用,关键在于将预测结果归因于训练数据,如同医学病例分析。这需要词元级别的精确性:不仅确定哪些训练样本影响决策,还需定位其中具体哪些词元起作用。尽管影响函数为此提供了理论框架,但现有方法仅限于自回归设置,且隐含假设词元独立性,导致影响推断不可靠。本文提出一种灵活框架,通过潜在中介方法实现一般预测任务下的词元级影响推断。该方法在预训练模型任意层附加稀疏自编码器,学习一组近似独立的潜在特征。不同于传统方法中影响在词元间可加性分解,基于潜在特征的影响天然不可加。为此,我们引入一种新颖方法,利用雅可比向量积进行计算。通过词元激活模式将潜在归因反向传播至输入空间,获得词元级影响。结合高效的逆海塞近似实现可扩展性。在医疗基准测试中,本方法识别出稀疏且可解释的词元集合,共同影响预测结果。该框架增强模型信任度,支持审计,适用于需透明与可问责决策的高风险领域。

原文摘要 · Abstract (English)

A critical step for reliable large language models (LLMs) use in healthcare is to attribute predictions to their training data, akin to a medical case study. This requires token-level precision: pinpointing not just which training examples influence a decision, but which tokens within them are responsible. While influence functions offer a principled framework for this, prior work is restricted to autoregressive settings and relies on an implicit assumption of token independence, rendering their identified influences unreliable. We introduce a flexible framework that infers token-level influence through a latent mediation approach for general prediction tasks. Our method attaches sparse autoencoders to any layer of a pretrained LLM to learn a basis of approximately independent latent features. Unlike prior methods where influence decomposes additively across tokens, influence computed over latent features is inherently non-decomposable. To address this, we introduce a novel method using Jacobian-vector products. Token-level influence is obtained by propagating latent attributions back to the input space via token activation patterns. We scale our approach using efficient inverse-Hessian approximations. Experiments on medical benchmarks show our approach identifies sparse, interpretable sets of tokens that jointly influence predictions. Our framework enhances trust and enables model auditing, generalizing to high-stakes domain requiring transparent and accountable decisions.

模型可解释性医疗AI潜在空间归因分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。