arXiv:2409.13694cs.CLcs.AI2024-09中稿 · CIKM 2025被引 14

提出多源知识剪枝框架,提升大模型问答准确性

Multi-Source Knowledge Pruning for Retrieval-Augmented Generation: A Benchmark and Empirical Study

  • 构建包含结构化与非结构化知识的多源基准数据集
  • 通过多粒度剪枝策略提升信息整合效率,减少误导性内容
  • 适合研究知识增强生成与信息筛选的学者使用

检索增强生成(RAG)通过引入外部知识有效缓解大语言模型的幻觉问题。然而,现有研究大多聚焦单一类型外部知识,而现实场景中常涉及多种异构知识源,该方向尚未充分探索。主要瓶颈在于缺乏包含多源知识的标准化数据集及前期问题分析。为此,我们构建了一个融合多样化互补领域中结构化与非结构化知识的基准数据集,并基于此开发了可即插即用的RAG框架PruningRAG。其核心是多粒度剪枝策略,在优化相关知识整合的同时,最小化误导性上下文的影响。该方法在多个现有RAG变体上均持续提升性能,展现良好鲁棒性与普适性。基于该数据集和框架,我们报告了一系列实验结果与深入发现。数据集与代码已公开,旨在推动RAG领域未来发展。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies focus on a single type of external knowledge source. However, in real-world applications, most situations involve diverse knowledge from various sources, yet this area has been less explored. The main dilemma is the lack of a suitable dataset containing multiple knowledge sources and pre-exploration of the associated issues. To address these challenges, we standardize a benchmark dataset that combines structured and unstructured knowledge across diverse and complementary domains. Based on this dataset, we further develop a plug-and-play RAG framework, \textbf{PruningRAG}, whose main characteristic is the use of multi-granularity pruning strategies to optimize the integration of relevant information while minimizing misleading context. It consistently improves performance across various existing RAG variants, demonstrating its robustness and broad applicability. Building upon the standardized dataset and PruningRAG, we also report a series of experimental results, as well as insightful findings. Our dataset and code are publicly available\footnote{https://github.com/USTCAGI/PruningRAG}, with the aim of advancing future research in the RAG community.

知识增强多源信息剪枝策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。