arXiv:2601.16478cs.CLcs.AI2026-01被引 2

提出DeepEra,用分步推理提升科学问答的证据筛选准确率

DeepEra: A Deep Evidence Reranking Agent for Scientific Retrieval-Augmented Generated Question Answering

  • 引入分步推理机制,精准区分语义相似但逻辑无关的文本
  • 在30万条科学问答数据上验证,显著降低幻觉并提升事实可靠性
  • 首个系统研究两阶段RAG中逻辑误导问题的工作,适合科研与AI医疗领域

随着科学文献的快速增长,科学问答(SciQA)在知识探索与利用中日益重要。检索增强生成(RAG)通过引入外部知识提升大模型表现,为科学问答提供可信证据。然而现有检索与重排序方法仍易受语义相近但逻辑无关文本干扰,导致事实可靠性下降并加剧幻觉。为此,我们提出深度证据重排序代理(DeepEra),融合分步推理,实现对候选段落更精确的评估,超越表层语义。为支持系统评估,我们构建了大规模数据集SciRAG-SSLI(包含约30万条跨10个学科的SciQA实例,基于1000万篇科学文献),结合自然检索结果与系统生成的干扰项,测试逻辑鲁棒性与事实根基性。全面评估表明,本方法在检索性能上优于主流重排序器。据我们所知,这是首个全面研究并实证验证两阶段RAG框架中显著的语义相似但逻辑无关(SSLI)问题的工作。

原文摘要 · Abstract (English)

With the rapid growth of scientific literature, scientific question answering (SciQA) has become increasingly critical for exploring and utilizing scientific knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating knowledge from external sources, thereby providing credible evidence for scientific question answering. But existing retrieval and reranking methods remain vulnerable to passages that are semantically similar but logically irrelevant, often reducing factual reliability and amplifying hallucinations.To address this challenge, we propose a Deep Evidence Reranking Agent (DeepEra) that integrates step-by-step reasoning, enabling more precise evaluation of candidate passages beyond surface-level semantics. To support systematic evaluation, we construct SciRAG-SSLI (Scientific RAG - Semantically Similar but Logically Irrelevant), a large-scale dataset comprising about 300K SciQA instances across 10 subjects, constructed from 10M scientific corpus. The dataset combines naturally retrieved contexts with systematically generated distractors to test logical robustness and factual grounding. Comprehensive evaluations confirm that our approach achieves superior retrieval performance compared to leading rerankers. To our knowledge, this work is the first to comprehensively study and empirically validate innegligible SSLI issues in two-stage RAG frameworks.

科学问答RAG证据重排序逻辑推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。