arXiv:2501.09957cs.CL2025-01ACL被引 12

提出灵活模块化框架FRAG,提升知识图谱增强生成的准确性和效率。

FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs

  • 根据查询复杂度动态选择推理路径检索策略
  • 在不微调模型情况下实现领先检索效果
  • 适合需要高效低资源的知识增强应用

为缓解大语言模型的幻觉与知识缺失问题,基于知识图谱(KG)的检索增强生成(RAG)展现出巨大潜力。然而现有方法在灵活性与检索质量间存在权衡:模块化方法虽灵活但检索质量受限;耦合方法虽提升质量却牺牲灵活性。本文提出新型灵活模块化框架FRAG,通过仅依据查询文本估算推理路径的跳数,并将其分类为简单或复杂,进而匹配相应检索管道,实现高效精准的路径检索。利用查询文本推断路径结构信息并采用可适配策略,FRAG在保持灵活性的同时显著提升检索质量。此外,无需额外微调或调用大模型,大幅提高效率并节省资源。大量实验表明,FRAG在性能、效率和资源消耗方面均达到当前最优水平。

原文摘要 · Abstract (English)

To mitigate the hallucination and knowledge deficiency in large language models (LLMs), Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) has shown promising potential by utilizing KGs as external resource to enhance LLMs reasoning. However, existing KG-RAG approaches struggle with a trade-off between flexibility and retrieval quality. Modular methods prioritize flexibility by avoiding the use of KG-fine-tuned models during retrieval, leading to fixed retrieval strategies and suboptimal retrieval quality. Conversely, coupled methods embed KG information within models to improve retrieval quality, but at the expense of flexibility. In this paper, we propose a novel flexible modular KG-RAG framework, termed FRAG, which synergizes the advantages of both approaches. FRAG estimates the hop range of reasoning paths based solely on the query and classify it as either simple or complex. To match the complexity of the query, tailored pipelines are applied to ensure efficient and accurate reasoning path retrieval, thus fostering the final reasoning process. By using the query text instead of the KG to infer the structural information of reasoning paths and employing adaptable retrieval strategies, FRAG improves retrieval quality while maintaining flexibility. Moreover, FRAG does not require extra LLMs fine-tuning or calls, significantly boosting efficiency and conserving resources. Extensive experiments show that FRAG achieves state-of-the-art performance with high efficiency and low resource consumption.

知识图谱检索增强大模型框架设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。