提出GASP方法,精准定位RAG生成中幻觉句子
Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)

- 通过扰动检索内容,衡量每句话依赖证据的程度
- 在三个基准上达到0.73(响应级)和0.67(片段级)AUC
- 无需训练即可用阈值检测,适合长文本生成场景
检索增强生成(RAG)虽减少但未消除幻觉,现有检测器仅给出整体分数,无法定位问题句及其原因。本文提出接地敏感性扰动检测方法(GASP),通过固定答案、分别在全上下文、无上下文及逐段移除条件下重评分,计算对数似然下降与詹森-香农散度,识别支持性句子与幻觉句的差异。基于随机非线性迭代函数系统(RNIFS)解释该差异。在三个基准(RAGTruth、TofuEval、RAGBench)上测试,使用三款模型(Qwen2.5-0.5B、Qwen2.5-1.5B、SmolLM2-1.7B)进行泄漏清洁评估。在RAGTruth上达响应级AUC≈0.73,片段级AUC≈0.67,显著优于困惑度、长度、完整上下文自然语言推理与自一致性基线;唯一体现竞争力的基线为配置良好的块级蕴含验证器,需额外模型,而无需训练的接地特征阈值可媲美训练分类器,成为默认检测器。信号可迁移至TofuEval,但在RAGBench短问答任务中不适用,表明GASP更适用于依赖检索上下文构建的输出。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) reduces but does not eliminate hallucination, and existing detectors return a single answer-level score that does not indicate which sentence is unsupported, or why. To close this gap, we introduce Grounding-Aware Sensitivity by Perturbation (GASP), a span-level detector that scores each answer sentence by how strongly its likelihood depends on the retrieved evidence, a quantity we term grounding sensitivity. GASP holds the answer fixed and re-scores it under the full context, under no context, and with each chunk removed, then measures the log-likelihood drops and Jensen-Shannon divergences (JSD). The likelihood of a grounded sentence collapses once its supporting passage is removed, whereas a hallucinated sentence is almost unaffected, a contrast we interpret by casting decoding as a random nonlinear iterated function system (RNIFS). We evaluate GASP on three benchmarks (RAGTruth, TofuEval, RAGBench) with three instruction-tuned scorers from two model families (Qwen2.5-0.5B, Qwen2.5-1.5B, and SmolLM2-1.7B) under a leakage-clean protocol. On RAGTruth it reaches a response-level area under the ROC curve (AUC) of about 0.73 and a span-level AUC of about 0.67, improving significantly over perplexity and by clear margins over length, whole-context natural language inference (NLI), and self-consistency baselines. The only baseline competitive at the span level is a well-configured chunk-level entailment verifier, which requires a separate model, whereas a training-free threshold on the grounding features matches the trained classifier without labeled data and serves as the default detector. Beyond RAGTruth, the signal transfers to TofuEval but not to short-answer question answering in RAGBench, showing GASP is best suited to outputs constructed from the retrieved context rather than answers recoverable from parametric knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。