arXiv:2607.22610cs.AIcs.CL2026-07被引 1

破解对话中多轮依赖关系,精准追踪答案来源。

Tokengeist: Multi-Turn Attribution Tracing in Agentic Conversations

论文配图:Tokengeist: Multi-Turn Attribution Tracing in Agentic Conversations
图 1 · 摘自论文原文
  • 将对话依赖建模为有向无环图,递归追溯每步来源。
  • 在4个模型上实现90%源召回率,远超传统方法的20%以下。
  • 适合研究模型推理机制或可解释性的研究人员。

当语言模型在多轮对话中生成回复时,哪些前期对话中的词元影响了该回答,它们之间的依赖关系如何跨轮传播?现有上下文归因方法仅单次处理完整上下文,只能发现表层依赖,无法捕捉真实对话中分层、非线性的结构。我们提出多轮上下文归因(MTCA):给定响应中一个目标片段,需追溯其在多轮对话中的来源,并揭示各轮之间的依赖关系。为此,我们提出Tokengeist——一种与归因方法无关且可扩展的框架,通过将归因视为对话轮次上的有向无环图(DAG)递归遍历,恢复完整的依赖路径。我们将发布MTCABench基准,包含665个多轮对话中的3,845个目标片段,标注了深度达14的黄金溯源图,涵盖四种依赖类型。在四个开源模型上,平面归因方法难以识别多跳依赖,源召回率低于20%,而Tokengeist达到90%。结果揭示了单次归因的系统性缺陷——我们称之为溯源崩溃,并推动需要跨轮递归推理的新型归因方法。

原文摘要 · Abstract (English)

When a language model produces a response in a multi-turn conversation, which tokens from prior turns shaped that answer, and how did those dependencies propagate across prior turns? Existing context attribution methods process the full context in a single pass, recovering surface-level dependencies but missing the layered, non-linear structure of real-world dialogues and multi-step reasoning tasks. We introduce multi-turn context attribution (MTCA): given a target span in a model response, the task of tracing attribution backward across turns to identify not only which prior turns were directly relevant, but also how those turns themselves depended on earlier context. We propose Tokengeist, an attribution-method-agnostic and scalable framework that recovers full dependency paths by casting attribution as a recursive traversal of a directed acyclic graph (DAG) over conversation turns. We will release MTCABench, a benchmark of 3,845 target spans across 665 multi-turn conversations, annotated with gold provenance graphs reaching depths of up to 14, across four dependency types. Across four open-weight models, flat attribution methods fail to recover multi-hop dependencies, achieving under 20% source recall, while Tokengeist reaches 90%. Our results reveal systematic failure modes of single-pass attribution -- which we term provenance collapse -- and motivate attribution methods that reason recursively across turns.

可解释性多轮对话归因分析AI推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。