通过迭代检索增强大模型推理,解决复杂时序逻辑问题。
Beyond Single Pass, Looping Through Time: KG-IRAG with Iterative Knowledge Retrieval
- 引入知识图谱的多轮迭代检索机制,逐步获取信息
- 在天气与交通场景中提升复杂推理准确率
- 适合需要动态数据与逻辑推演的任务场景
图检索增强生成(GraphRAG)已证明能有效提升大语言模型在需外部知识的任务中的表现。通过利用知识图谱(KG),GraphRAG提高了复杂推理任务的信息检索精度与完整性,生成更准确的回答。然而,多数RAG方法难以处理多步推理,尤其当信息提取与逻辑推断并行时。为此,本文提出基于知识图谱的迭代检索增强生成(KG-IRAG)框架,将知识图谱与迭代推理结合,增强大模型处理含时间与逻辑依赖查询的能力。通过多轮检索,KG-IRAG逐步从外部知识图谱中获取相关数据,实现分步推理。该方法特别适用于需结合动态时间数据与推理的场景,如根据天气和交通状况确定最佳出行时间。实验表明,KG-IRAG在复杂推理任务中显著提升准确率。此外,本文构建了三个新数据集:weatherQA-Irish、weatherQA-Sydney、trafficQA-TFNSW,用于评估其性能,验证了其超越传统RAG应用的潜力。
原文摘要 · Abstract (English)
Graph Retrieval-Augmented Generation (GraphRAG) has proven highly effective in enhancing the performance of Large Language Models (LLMs) on tasks that require external knowledge. By leveraging Knowledge Graphs (KGs), GraphRAG improves information retrieval for complex reasoning tasks, providing more precise and comprehensive retrieval and generating more accurate responses to QAs. However, most RAG methods fall short in addressing multi-step reasoning, particularly when both information extraction and inference are necessary. To address this limitation, this paper presents Knowledge Graph-Based Iterative Retrieval-Augmented Generation (KG-IRAG), a novel framework that integrates KGs with iterative reasoning to improve LLMs' ability to handle queries involving temporal and logical dependencies. Through iterative retrieval steps, KG-IRAG incrementally gathers relevant data from external KGs, enabling step-by-step reasoning. The proposed approach is particularly suited for scenarios where reasoning is required alongside dynamic temporal data extraction, such as determining optimal travel times based on weather conditions or traffic patterns. Experimental results show that KG-IRAG improves accuracy in complex reasoning tasks by effectively integrating external knowledge with iterative, logic-based retrieval. Additionally, three new datasets: weatherQA-Irish, weatherQA-Sydney, and trafficQA-TFNSW, are formed to evaluate KG-IRAG's performance, demonstrating its potential beyond traditional RAG applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。