用大模型生成细粒度反馈,让检索器更懂大模型想要的答案。
Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in Retrieval-Augmented Generation
- 通过大模型构造检索失败样本的细粒度示例,引导检索器学习。
- 在多个数据集上提升检索准确率,关键指标最高提升12.7%。
- 适合需要降低幻觉、优化检索的RAG系统开发者使用。
检索增强生成(RAG)已被证明能有效缓解大语言模型(LLM)固有的幻觉问题。以往方法通常基于语义相似性训练检索器,未针对RAG场景进行优化。近期工作尝试对齐检索器与LLM的偏好信号,但这些信号对语义能力较弱的密集检索器而言难以理解。受引导发现学习等教育理论启发,本文提出新框架FiGRet(细粒度检索指导),利用LLM的语言能力从检索器表现不佳的样本中构建信息中心的、易理解的示例,聚焦相关性、全面性和纯净性三个与RAG高度相关的学习目标。这些示例作为支架,引导检索器逐步对齐LLM的偏好。此外,采用双课程学习策略,并利用LLM与检索器间的双向反馈进一步提升RAG性能。实验表明,该框架可显著提升不同检索器和多种LLM下的RAG系统表现。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has proven to be an effective method for mitigating hallucination issues inherent in large language models (LLMs). Previous approaches typically train retrievers based on semantic similarity, lacking optimization for RAG. More recent works have proposed aligning retrievers with the preference signals of LLMs. However, these preference signals are often difficult for dense retrievers, which typically have weaker language capabilities, to understand and learn effectively. Drawing inspiration from pedagogical theories like Guided Discovery Learning, we propose a novel framework, FiGRet (Fine-grained Guidance for Retrievers), which leverages the language capabilities of LLMs to construct examples from a more granular, information-centric perspective to guide the learning of retrievers. Specifically, our method utilizes LLMs to construct easy-to-understand examples from samples where the retriever performs poorly, focusing on three learning objectives highly relevant to the RAG scenario: relevance, comprehensiveness, and purity. These examples serve as scaffolding to ultimately align the retriever with the LLM's preferences. Furthermore, we employ a dual curriculum learning strategy and leverage the reciprocal feedback between LLM and retriever to further enhance the performance of the RAG system. A series of experiments demonstrate that our proposed framework enhances the performance of RAG systems equipped with different retrievers and is applicable to various LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。