RAG系统答对了却可能错得一致,本文揭穿了这种‘锁定式错误’的真相。
When Confidence Takes the Wrong Path: Diagnosing Retrieval-State Lock-In in RAG

- 区分答案、证据和检索状态,诊断错误是否因固定检索态导致
- 5次采样下42%的KG-RAG错误和59%的密集检索错误无答案差异,掩盖风险
- 三重验证通过时精度达91.9%,适合高可靠性场景但覆盖有限
RAG系统的可信度不仅取决于回答结果,许多黑箱不确定性方法仍将多个样本答案的一致性视为置信度。当重复采样均基于同一有缺陷的检索状态时,这种判断会失效:检索状态可能为空,模型依赖参数记忆;也可能包含连贯但错误的邻域内容。两种情况下答案一致是因为错误稳定。该问题在部署中已存在,但缺乏名称、可测量特征与普遍性边界。本文提出命名此现象为‘检索状态锁定’,并通过解耦单一置信度所混淆的三个要素——答案表面、检索证据与检索状态本身——进行诊断。在一个可检查的、基于本体的知识图谱增强型RAG(KG-RAG)系统上,针对六个问答快照进行分析,直接测量了同意盲区:每题5次采样下,42%的KG-RAG错误与59%的密集检索错误呈现零答案离散度,说明一致性无法反映真实可靠性;而证据与检索状态检测仍能识别多数错误。该分解支持可审计的决策规则:仅当答案、证据与检索状态均判定为低风险时才接受,可达到91.9%的综合精确率,远超79.7%的全接受率。代价是覆盖率降低至仅7.7%的答案被认证为低风险。在临床校准领域,自动评判下可达100%精确率,此为域内自动标签上限,并非临床安全承诺,仍需人工验证。RAG中的置信度应具对象特异性:当答案一致时,真正问题是信任链中哪一环节出了问题。
原文摘要 · Abstract (English)
The trustworthiness of a retrieval-augmented generation (RAG) system depends on more than the answer it returns, yet many black-box uncertainty methods still read agreement among sampled answers as confidence. That inference fails when repeated samples condition on the same defective retrieval state. The state may be empty, with the model falling back on parametric memory, or populated by a coherent but wrong neighbourhood. In either case, the answers agree because the error is stable. The problem is recognised in deployed RAG, but it has lacked a name, a measurable signature, and a prevalence bound. We supply all three. We name the failure retrieval-state lock-in and diagnose it by separating the three objects a single confidence score conflates: the answer surface, the retrieved evidence, and the retrieval state itself. In an inspectable, ontology-guided knowledge-graph RAG (KG-RAG) system across six question-answering snapshots, we measure the agreement blind spot directly: at five samples per question, 42% of KG-RAG errors and 59% of dense-retrieval errors carry zero answer dispersion, so agreement has nothing to rank, while evidence- and retrieval-state checks still flag most of them. The decomposition supports an auditable decision rule: accepting an answer only when answer, evidence, and retrieval checks all agree that it is low-risk reaches 91.9% pooled precision against a 69.7% accept-all rate. The cost is coverage: it certifies only 7.7% of answers as low-risk. On the clinical calibration domain it reaches 100% precision under an automated judge; this is an in-domain automated-label upper bound, not a clinical safety claim, and still needs human validation. Confidence in RAG is object-specific: when answers agree, the useful question is which part of the pipeline to distrust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。