arXiv:2608.26385cs.CLcs.AI2026-08

提出新评估框架,揭示RAG系统为何会胡说八道。

Why RAGs Hallucinate: Penalty-Aware Evaluation of Retrieval-Augmented Generation Systems with Knowledge-Gap Canaries

  • 用不对称打分+知识缺口探针,精准识别胡说答案
  • 三款商用RAG系统胡说率差6倍,正确率却都超97%
  • 关键在是否该答时不答,适合产品验收与安全评估

基于准确性奖励的体积评价机制使检索增强生成(RAG)系统倾向于猜测:答得越多得分越高,即使回答无依据。本文基于Kalai等(2025)的置信度目标分析,提出一种面向部署式RAG产品的惩罚感知评估框架,包含三要素:(i) 非对称评分(正确+1,错误-4,弃答0);(ii) 知识缺口探针(答案明确不在知识库中的问题),任何回答即为参数记忆的无根据生成;(iii) 失败归因流水线,分离检索、生成与弃答策略失败。在SimpleQA-Verified数据集(1,000个问题×3次重复,交叉家族三评审员盲评,一致率达98.9%)上测试三款商用RAG系统与无检索基线,发现其回答正确率高度集中(97.0%-98.0%),但探针违规率相差约六倍(16.7% vs. 98.1%)。系统差异主要不在于答对多少,而在于是否应在不该答时选择弃答;惩罚感知评分据此重新排序,且在惩罚系数k=1至k=9间稳定。所有代码、配置、记录与评审票数均已公开,供独立审计。

原文摘要 · Abstract (English)

Volume-based accuracy rewards retrieval-augmented generation (RAG) systems for guessing: a system that answers everything outscores one that declines when its knowledge base cannot support an answer. Building on the confidence-target analysis of Kalai et al. (2025), we present a penalty-aware evaluation framework for deployed RAG products, combining (i) asymmetric scoring (correct +1, wrong -4, abstain 0), (ii) knowledge-gap canaries, questions whose answers are verifiably absent from the knowledge base, so that any answer constitutes ungrounded generation from parametric memory, and (iii) a failure-attribution pipeline that separates retrieval, generation, and abstention-policy failures. Applying the framework to three commercial RAG systems and a no-retrieval baseline on SimpleQA-Verified (1,000 questions x 3 repeats, graded blind by a cross-family three-judge panel with 98.9% unanimity), we find that accuracy when answering is closely clustered across systems (97.0-98.0%), while canary violation rates differ roughly sixfold (16.7% vs. 98.1%). The systems are separated less by what they answer correctly than by whether they answer at all when they should not, and penalty-aware scoring reorders the volume-based ranking accordingly; the reordering is stable across penalty settings from k=1 to k=9. All code, configurations, transcripts, and judge votes are released for independent audit.

RAG评估幻觉检测知识缺口产品安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。