arXiv:2508.05660cs.IRcs.AI2025-08综述被引 6

开源智能代理框架,让论文综述自动选图谱或向量检索,更准更可信。

Open-Source Agentic Hybrid RAG Framework for Scientific Literature Review

  • 用智能代理动态选择图谱或向量检索,按需匹配查询类型
  • 在合成测试中,上下文召回率提升0.63,答案相关性增0.12
  • 支持不确定性估计,适合科研人员做可复现的智能文献综述

科学论文爆炸式增长,传统综述方法难以应对,亟需融合结构化元数据与全文分析的工具。现有混合检索增强生成(Hybrid RAG)系统多为静态、依赖专有工具且缺乏置信度估计。本文提出一种自主代理框架,将混合RAG流程封装为智能体,可动态选择图谱检索(GraphRAG)或向量检索(VectorRAG),实时适配指令微调生成,并在推理中量化不确定性。该框架接入PubMed、arXiv和Google Scholar开放数据,构建基于引用关系的Neo4j知识图谱(KG),使用all-MiniLM-L6-v2模型将全文字PDF嵌入到FAISS向量存储(VS)中。采用Llama-3.3-70B代理判断应使用图谱查询(转译为Cypher)还是向量检索(结合稀疏与稠密检索并重排序)。通过指令微调优化领域生成能力,基于自举评估获得评价指标标准差。在模拟真实场景的合成基准上,经直接偏好优化(DPO)微调的智能体优于基线:向量存储上下文召回率提升0.63,整体上下文精确率增0.56;额外提升包括向量存储忠实度+0.24,向量存储精确率+0.12,知识图谱答案相关性+0.12,整体忠实度+0.11,知识图谱上下文召回率+0.05,向量存储答案相关性及整体精确率各+0.04。结果表明系统在异构源间推理能力更强,具备可扩展的自主科学发现潜力。

原文摘要 · Abstract (English)

The surge in scientific publications challenges traditional review methods, demanding tools that integrate structured metadata with full-text analysis. Hybrid Retrieval Augmented Generation (RAG) systems, combining graph queries with vector search offer promise but are typically static, rely on proprietary tools, and lack uncertainty estimates. We present an agentic approach that encapsulates the hybrid RAG pipeline within an autonomous agent capable of (1) dynamically selecting between GraphRAG and VectorRAG for each query, (2) adapting instruction-tuned generation in real time to researcher needs, and (3) quantifying uncertainty during inference. This dynamic orchestration improves relevance, reduces hallucinations, and promotes reproducibility. Our pipeline ingests bibliometric open-access data from PubMed, arXiv, and Google Scholar APIs, builds a Neo4j citation-based knowledge graph (KG), and embeds full-text PDFs into a FAISS vector store (VS) using the all-MiniLM-L6-v2 model. A Llama-3.3-70B agent selects GraphRAG (translating queries to Cypher for KG) or VectorRAG (combining sparse and dense retrieval with re-ranking). Instruction tuning refines domain-specific generation, and bootstrapped evaluation yields standard deviation for evaluation metrics. On synthetic benchmarks mimicking real-world queries, the Instruction-Tuned Agent with Direct Preference Optimization (DPO) outperforms the baseline, achieving a gain of 0.63 in VS Context Recall and a 0.56 gain in overall Context Precision. Additional gains include 0.24 in VS Faithfulness, 0.12 in both VS Precision and KG Answer Relevance, 0.11 in overall Faithfulness score, 0.05 in KG Context Recall, and 0.04 in both VS Answer Relevance and overall Precision. These results highlight the system's improved reasoning over heterogeneous sources and establish a scalable framework for autonomous, agentic scientific discovery.

文献综述智能代理RAG知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。