arXiv:2508.08942cs.CLcs.IR2025-08

让大模型生成答案时同步给出文档来源,减少幻觉。

Jointly Generating and Attributing Answers using Logits of Document-Identifier Tokens

  • 用特殊标记符的激活值判断文档贡献度。
  • 在Trust-Align测试中超越现有模型多项指标。
  • 效率高且适配不同场景,适合可信AI研究者。

尽管大型语言模型表现优异,仍易产生幻觉,严重削弱其可信度。以往工作多关注答案与归属的准确性,近期研究转向忠实性,利用模型内部信号反映实际决策过程。然而这些方法增加延迟,且难以对齐生成与归属。本文提出LoDIT,通过生成时利用特定标记符的logits,实现回答与归属的联合生成。该方法分两步:首先在文档中标记特定标识符,再基于这些标识符的logits估计各文档对答案的贡献;最后聚合贡献得到归属结果。在注重可信度的标注文本生成基准Trust-Align上,LoDIT显著优于当前最优模型。深入分析表明,该方法在延迟和不同设置下均具高效性与鲁棒性。

原文摘要 · Abstract (English)

Despite their impressive performances, Large Language Models (LLMs) remain prone to hallucination, which critically undermines their trustworthiness. While most of the previous work focused on tackling answer and attribution correctness, a recent line of work investigated faithfulness, with a focus on leveraging internal model signals to reflect a model's actual decision-making process while generating the answer. Nevertheless, these methods induce additional latency and have shown limitations in directly aligning token generation with attribution generation. In this paper, we introduce LoDIT, a method that jointly generates and faithfully attributes answers in RAG by leveraging specific token logits during generation. It consists of two steps: (1) marking the documents with specific token identifiers and then leveraging the logits of these tokens to estimate the contribution of each document to the answer during generation, and (2) aggregating these contributions into document attributions. Experiments on a trustworthiness-focused attributed text-generation benchmark, Trust-Align, show that LoDIT significantly outperforms state-of-the-art models on several metrics. Finally, an in-depth analysis of LoDIT shows both its efficiency in terms of latency and its robustness in different settings.

大模型可信生成RAG归因

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。