给大模型的幻觉定位归因并追溯证据,提升可信度。
HART: Data-Driven Hallucination Attribution and Evidence-Based Tracing for Large Language Models
- 将幻觉追溯建模为四个阶段的结构化任务
- 在新数据集上超越传统检索方法,显著提升追踪效果
- 适合关注模型可解释性与事实准确性的研究者
大型语言模型在文本生成和知识密集型问答中表现卓越,但易产生幻觉内容,严重影响其在高风险场景下的可靠性。现有归因方法多依赖外部知识检索或内部机制,主要基于语义相似性匹配或表示层判别,难以在片段层面建立幻觉类型、错误生成机制与外部事实证据之间的结构化对应关系,限制了幻觉片段的可解释性与证据追溯能力。为此,我们提出HART,一种细粒度的幻觉归因与证据检索框架。HART将幻觉追溯形式化为包含四个阶段的结构化建模任务:片段定位、机制归因、证据检索与因果追溯。基于此,我们构建了首个专用于幻觉追溯的结构化数据集,其中联合标注了幻觉类型、错误机制及反事实证据集合,支持因果级可解释性评估。在该数据集上的实验表明,HART显著优于强基线方法(包括BM25和DPR),验证了所提追溯范式的有效性与泛化能力。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable performance in text generation and knowledge-intensive question answering. Nevertheless, they are prone to producing hallucinated content, which severely undermines their reliability in high-stakes application domains. Existing hallucination attribution approaches, based on either external knowledge retrieval or internal model mechanisms, primarily focus on semantic similarity matching or representation-level discrimination. As a result, they have difficulty establishing structured correspondences at the span level between hallucination types, underlying error generation mechanisms, and external factual evidence, thereby limiting the interpretability of hallucinated fragments and the traceability of supporting or opposing evidence. To address these limitations, we propose HART, a fine-grained hallucination attribution and evidence retrieval framework for large language models. HART formalizes hallucination tracing as a structured modeling task comprising four stages: span localization, mechanism attribution, evidence retrieval, and causal tracing. Based upon this formulation, we develop the first structured dataset tailored for hallucination tracing, in which hallucination types, error mechanisms, and sets of counterfactual evidence are jointly annotated to enable causal-level interpretability evaluation. Experimental results on the proposed dataset demonstrate that HART substantially outperforms strong retrieval baselines, including BM25 and DPR, validating the effectiveness and generalization capability of the proposed tracing paradigm for hallucination analysis and evidence alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。