arXiv:2605.14175cs.AI2026-05被引 2

用依赖图实时验证大模型对话,防幻觉且效率高。

Grounded Continuation: A Linear-Time Runtime Verifier for LLM Conversations

  • 构建显式依赖图,用符号引擎追踪论点与证据关系
  • 在长对话中准确识别过时前提,错误率降6.7个百分点
  • 适合对安全性要求高的对话系统部署,如客服、医疗问答

在长对话中,大模型可能生成看似合理但基于已放弃前提的回应。现有攻击正利用这一漏洞。本文提出一种运行时验证器,通过维护显式依赖图实现高效检测:大模型将每轮对话分类为8种来自四种形式系统的更新操作(动态认知逻辑、溯因推理、意识逻辑、论证理论),符号引擎记录各主张对证据的依赖关系。判断延续是否被支持仅需图遍历;撤回操作沿图传播,精准标记失去支持的结论,每轮开销线性,且具有形式化无冲突保障。在LongMemEval-KU oracle(n=78)上,验证器达89.7%准确率,优于大模型基线(88.5%,+1.3pp)和匹配检索预算的摘要-RAG基线(87.2%,+2.6pp);分歧中胜出者为正确拒绝,而基线会编造。在LoCoMo 60个官方问答项上表现与检索增强基线相当。额外构建两个多智能体场景与50项接地测试:在15项过时前提子集上,验证器达100%准确率,基线为93.3%(+6.7pp)。这体现了一致性-忠实性分解:结构检查天然一致,而每部署场景下大模型提取的忠实性是可实证测量的经验问题。撤回检查耗时微秒级,而历史重播随对话长度线性增长。

原文摘要 · Abstract (English)

In long conversations, an LLM can produce a next utterance that sounds plausible but rests on premises the conversation has already abandoned. Context-manipulation attacks against deployed agents now actively exploit this gap. We close it with a runtime verifier that maintains an explicit dependency graph: an LLM classifies each turn into one of 8 update operations drawn from four formalisms (dynamic epistemic logic, abductive reasoning, awareness logic, argumentation), and a symbolic engine records which claims depend on which evidence. Checking whether a continuation is supported reduces to a graph walk; retraction propagates through the same graph to flag exactly the conclusions that lose support, with linear per-turn cost and a formal conflict-free guarantee. On LongMemEval-KU oracle (n=78), the verifier reaches 89.7% accuracy vs. 88.5% for the LLM-only baseline (+1.3pp) and 87.2% for a transcript-RAG baseline matched on retrieval budget (+2.6pp); wins among disagreements are correct abstentions where the baseline confabulates. On LoCoMo's 60 official QA items the verifier is competitive with retrieval-augmented baselines. Beyond external benchmarks, we construct two multi-agent scenarios and a 50-item grounding test: on the 15-item stale-premise subset, the verifier reaches 100% accuracy vs. 93.3% (+6.7pp). These instantiate a soundness-faithfulness decomposition: the structural check is sound by construction, and per-deployment LLM extraction faithfulness is the empirical question we measure across four LLM families. The retraction check plateaus at microseconds while history-replay grows linearly with conversation length.

对话验证幻觉检测依赖图大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。