arXiv:2511.03900cs.CLcs.LG2025-11被引 1

用语料构建图谱,动态调整生成,让大模型少说假话。

GRAD: Graph-Retrieved Adaptive Decoding for Hallucination Mitigation

  • 通过语料生成稀疏词元转移图,实时融合证据优化生成
  • 相比贪心解码,内生准确性提升9.7%,幻觉率降8.6%
  • 无需重训练,适合想提升事实性又不想改结构的用户

大语言模型的幻觉问题仍难以解决,现有方法多依赖外部知识源,但提示引导易失效,符号化知识整合成本高。我们提出一种解码时方法GRAD,基于语料构建稀疏词元转移图,在单次前向传播中积累下一个词的概率分布。解码时,将图检索到的词概率进行最大值归一化,并自适应地与模型原概率融合,优先选择高证据支持的延续,同时保持语言流畅性。在三个模型和多个问答基准测试中,GRAD持续优于基线,内生准确率最高提升9.7%,幻觉率降低8.6%,正确率比贪心解码高出6.9%,且在所有方法中取得最高的真理性-信息量乘积得分。GRAD是一种轻量级、即插即用的替代方案,证明了语料级词元转移统计证据可有效引导生成更可信、可验证的结果。

原文摘要 · Abstract (English)

Hallucination mitigation remains a persistent challenge for large language models (LLMs), even as model scales grow. Existing approaches often rely on external knowledge sources, such as structured databases or knowledge graphs, accessed through prompting or retrieval. However, prompt-based grounding is fragile and domain-sensitive, while symbolic knowledge integration incurs heavy retrieval and formatting costs. Motivated by knowledge graphs, we introduce Graph-Retrieved Adaptive Decoding (GRAD), a decoding-time method that grounds generation in corpus-derived evidence without retraining. GRAD constructs a sparse token transition graph by accumulating next-token logits across a small retrieved corpus in a single forward pass. During decoding, graph-retrieved logits are max-normalized and adaptively fused with model logits to favor high-evidence continuations while preserving fluency. Across three models and a range of question-answering benchmarks spanning intrinsic, extrinsic hallucination, and factuality tasks, GRAD consistently surpasses baselines, achieving up to 9.7$\%$ higher intrinsic accuracy, 8.6$\%$ lower hallucination rates, and 6.9$\%$ greater correctness compared to greedy decoding, while attaining the highest truth--informativeness product score among all methods. GRAD offers a lightweight, plug-and-play alternative to contrastive decoding and knowledge graph augmentation, demonstrating that statistical evidence from corpus-level token transitions can effectively steer generation toward more truthful and verifiable outputs.

幻觉抑制解码优化知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。