arXiv:2603.17872cs.CLcs.AI2026-03

用分层检索+验证机制,让大模型生成内容更靠谱。

Mitigating LLM Hallucinations through Domain-Grounded Tiered Retrieval

  • 四阶段自调节流程:先自查、再定向搜、去冗余、后原子级验证。
  • 在多个数据集上准确率最高达83.7%,事实性得分稳定在78.8%~86.4%。
  • 适合高可靠性需求场景,如医疗、金融等专业对话系统。

大语言模型虽流畅,但易产生事实错误。本文提出一种领域引导的分层检索与验证架构,通过四阶段自调节流水线(基于LangGraph实现)将模型从模式匹配转向可信事实获取:(I) 基于早退逻辑的内在验证以优化算力;(II) 利用领域检测器引导至特定知识库的自适应搜索路由;(III) 精细上下文过滤(RCF)剔除无关信息;(IV) 外在重生成并进行原子级断言验证。在5个不同基准测试中评估了650个查询,结果表明该框架在所有环境中均优于零样本基线。在TimeQA v2中胜率达83.7%,在MMLU Global Facts中达78.0%,证实其在时间与数值精度要求高的领域高效可靠。事实性得分在78.8%至86.4%之间保持稳定。然而仍存在‘错误前提过度主张’的顽固缺陷。研究为多阶段RAG行为提供了实证分析,并建议未来工作应引入预检索‘可答性’节点以进一步提升对话AI的可靠性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have achieved unprecedented fluency but remain susceptible to "hallucinations" - the generation of factually incorrect or ungrounded content. This limitation is particularly critical in high-stakes domains where reliability is paramount. We propose a domain-grounded tiered retrieval and verification architecture designed to systematically intercept factual inaccuracies by shifting LLMs from stochastic pattern-matchers to verified truth-seekers. The proposed framework utilizes a four-phase, self-regulating pipeline implemented via LangGraph: (I) Intrinsic Verification with Early-Exit logic to optimize compute, (II) Adaptive Search Routing utilizing a Domain Detector to target subject-specific archives, (III) Refined Context Filtering (RCF) to eliminate non-essential or distracting information, and (IV) Extrinsic Regeneration followed by atomic claim-level verification. The system was evaluated across 650 queries from five diverse benchmarks: TimeQA v2, FreshQA v2, HaluEval General, MMLU Global Facts, and TruthfulQA. Empirical results demonstrate that the pipeline consistently outperforms zero-shot baselines across all environments. Win rates peaked at 83.7% in TimeQA v2 and 78.0% in MMLU Global Facts, confirming high efficacy in domains requiring granular temporal and numerical precision. Groundedness scores remained robustly stable between 78.8% and 86.4% across factual-answer rows. While the architecture provides a robust fail-safe for misinformation, a persistent failure mode of "False-Premise Overclaiming" was identified. These findings provide a detailed empirical characterization of multi-stage RAG behavior and suggest that future work should prioritize pre-retrieval "answerability" nodes to further bridge the reliability gap in conversational AI.

大模型幻觉抑制检索增强事实验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。