通过优化提示设计提升图结构RAG的多跳问答能力。
PROPEX-RAG: Enhanced GraphRAG using Prompt-Driven Prompt Execution
- 用提示驱动构建知识图谱并动态筛选实体与事实。
- 在HotpotQA和2WikiMultiHopQA上分别达到80.7%和78.9%的F1分数。
- 适合研究高效多跳推理与提示工程的从业者。
检索增强生成(RAG)已成为提升大语言模型外部知识能力的稳健框架。尽管近期研究探索了基于图的检索以支持复杂推理,但提示设计对检索与推理过程的影响仍被忽视。本文提出一种提示驱动的GraphRAG框架,强调提示设计在实体抽取、事实选择和段落重排序中的关键作用。通过将文本数据编码为结构化三元组,构建符号化知识图谱;在线检索中仅选择性使用大模型进行语义过滤与答案生成;并采用基于个性化页面排名(PPR)的实体引导图遍历,实现高效可扩展的检索。系统在HotpotQA和2WikiMultiHopQA上分别取得80.7%和78.9%的F1分数,以及97.1%和98.1%的Recall@5,证明提示设计是提升检索准确率与回答质量的重要环节。该研究为更高效、可解释的多跳问答系统奠定基础,凸显提示感知图推理的价值。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the influence of prompt design on enhancing the retrieval and reasoning process is still considerably under-examined. In this paper, we present a prompt-driven GraphRAG framework that underscores the significance of prompt formulation in facilitating entity extraction, fact selection, and passage reranking for multi-hop question answering. Our approach creates a symbolic knowledge graph from text data by encoding entities and factual relationships as structured facts triples. We use LLMs selectively during online retrieval to perform semantic filtering and answer generation. We also use entity-guided graph traversal through Personalized PageRank (PPR) to support efficient, scalable retrieval based on the knowledge graph we built. Our system gets state-of-the-art performance on HotpotQA and 2WikiMultiHopQA, with F1 scores of 80.7% and 78.9%, and Recall@5 scores of 97.1% and 98.1%, respectively. These results show that prompt design is an important part of improving retrieval accuracy and response quality. This research lays the groundwork for more efficient and comprehensible multi-hop question-answering systems, highlighting the importance of prompt-aware graph reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。