arXiv:2603.10143cs.CL2026-03中稿 · Canadian AI 2026

让大模型回答更可信:通过推理+验证框架减少幻觉

Reason and Verify: A Framework for Faithful Retrieval-Augmented Generation

  • 用重写查询和证据重排增强检索,生成带依据的推理链条
  • 在生物医学问答中达到89.1%准确率,媲美更大模型
  • 支持细粒度错误诊断,适合医疗等高风险场景使用

检索增强生成(RAG)显著提升大语言模型的事实性,但标准流程缺乏对中间推理的验证机制,在高风险领域易产生幻觉。为此,我们提出一种领域专用RAG框架,集成显式推理与可信度验证。架构通过神经查询重写、BGE跨编码器重排以及基于证据片段的子命题生成模块,增强标准检索能力。引入八类验证分类体系,区分显式与隐式支持模式,实现结构化错误诊断。在BioASQ和PubMedQA基准上评估,分析了受限上下文长度下动态示例选择与重排的影响。实验表明,显式推理生成可提升准确率;动态示范选择结合强重排在少样本设置下进一步增益。使用Llama-3-8B-Instruct模型,该方法在BioASQ-Y/N上达89.1%,PubMedQA上达73.0%,性能媲美参数更大的系统。另开展试点研究,结合人工专家评估与LLM验证,探索显式推理如何提升系统透明度并深入诊断检索失败。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in high-stakes domains. To address this, we propose a domain-specific RAG framework that integrates explicit rea- soning and faithfulness verification. Our architecture augments standard retrieval with neural query rewriting, BGE-based cross-encoder reranking, and a rationale generation module that grounds sub-claims in specific evidence spans. We further introduce an eight-category verification taxonomy that enables fine-grained assessment of rationale faithfulness, distinguishing between explicit and implicit support patterns to facilitate structured error diagnosis. We evaluate this framework on the BioASQ and PubMedQA benchmarks, specifically analyzing the impact of dynamic in-context learning and rerank- ing under constrained token budgets. Experiments demonstrate that explicit rationale generation improves accuracy over vanilla RAG baselines, while dynamic demonstration selection combined with robust reranking yields further gains in few-shot settings. Using Llama-3-8B-Instruct, our approach achieves 89.1% on BioASQ-Y/N and 73.0% on Pub- MedQA, competitive with systems using significantly larger models. Additionally, we perform a pilot study combining human expert assessment with LLM-based verification to explore how explicit rationale generation improves system transparency and enables more detailed diagnosis of retrieval failures in biomedical question answering.

RAG可信生成医学问答推理验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。