arXiv:2608.23811cs.AI2026-08

用强化学习让AI生成可解释的医学事实核查报告

Generating Biomedical Fact-Checking Reports with RL-Enhanced Agentic Search

论文配图:Generating Biomedical Fact-Checking Reports with RL-Enhanced Agentic Search
图 1 · 摘自论文原文
  • 构建能自主搜索PubMed的智能体,结合检索与分析生成报告
  • 相比基础模型,事实判断准确率提升9.95%,幻觉减少19.63%
  • 适合医疗信息审核、科研辅助等需要高可信度的场景

自动化事实核查对保障公共卫生信息可靠性至关重要,但生物医学领域因需严谨解读科学文献、评估证据并充分论证而更具挑战。现有基于大语言模型(LLM)与检索增强生成(RAG)的智能体虽能执行检索-验证流程,但仍仅输出支持或驳回标签,缺乏解释性,难以辅助人类理解。为此,我们提出名为BioCheck Agent的基于LLM的智能体,可生成结构化生物医学事实核查报告。该智能体不仅输出结论,还融合检索证据与严谨分析。为确保领域准确性,其仅在PubMed中检索高质量文献,并使用高级布尔运算符。针对轻量级开源模型易产生幻觉的问题,我们设计了面向证据的组相对策略优化(EG-GRPO),通过任务特异性奖励鼓励精准搜索与高质量证据获取,惩罚幻觉行为。实验表明,相较于基线模型Qwen3.5-4B,采用EG-GRPO的BioCheck Agent在SciFact数据集上标签预测准确率提升9.95%,证据质量得分提高3.7%,幻觉率降低19.63%,展现出更强的准确性和报告质量。

原文摘要 · Abstract (English)

Automated fact-checking is essential for ensuring the reliability of public health information, yet the biomedical domain poses unique challenges. Validating biomedical claims requires rigorous interpretation of scientific literature, assessment of retrieved evidence, and comprehensive justification toward the conclusion. Although Large Language Models (LLMs) enhanced by Retrieval-Augmented Generation (RAG) and agentic search perform automated fact-checking in a retrieve-then-verify paradigm, current methods still output isolated prediction labels, lacking explanatory depth and offers limited utility for human understanding. To bridge this gap, we introduce an LLM-based agent named BioCheck Agent that generates structured biomedical fact-checking reports with agentic search. Rather than merely outputting supported or refuted labels, our agent synthesizes final conclusions with retrieved evidence and rigorous analysis. To ensure domain-specific accuracy, BioCheck Agent exclusively searches high-quality scientific literature in PubMed, utilizing advanced Boolean search operators. Recognizing that direct prompting often results in hallucinations and low-quality reports, especially for lightweight open-source models, we further propose the Evidence-Grounded Group Relative Policy Optimization (EG-GRPO) to perform reinforcement learning on BioCheck Agent with a task-specific reward that incentivizes advanced search behavior and high-quality evidence retrieval while penalizing hallucinations. Our experimental results show that compared to the base model Qwen3.5-4B, BioCheck Agent with EG-GRPO improves label prediction accuracy on SciFact by 9.95%. Furthermore, it achieves a 3.7% higher evidence quality score and a 19.63% lower evidence hallucination rate, demonstrating its ability to generate biomedical fact-checking reports with improved accuracy and quality.

事实核查医学AI强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。