通过知识互换与分层对比重排,提升问答系统准确性。
Cooperative Retrieval-Augmented Generation for Question Answering: Mutual Information Exchange and Ranking by Contrasting Layers

- 检索器与大模型协作互换信息,增强推理链完整性。
- 在三个多跳问答数据集上,检索与问答性能均超越当前最佳方法。
- 适合需要高精度事实生成的复杂问答场景。
大型语言模型(LLMs)常产生事实性错误,因此基于检索的生成(RAG)成为缓解此问题的关键方法。然而,现有RAG方法在简单和多跳问答任务中仍易出现错误检索与幻觉。为此,我们提出CoopRAG,一种新型RAG框架,使检索器与大模型通过交换信息协同工作,并利用检索器前后层间的对比机制精准排序相关文档。该框架首先将问题拆解为带掩码的子问题与推理链,再基于扩展后的查询检索文档,通过对比检索器各层特征进行重排,并由大模型填回掩码位置以重构推理链。实验表明,CoopRAG在三个多跳问答数据集及一个简单问答数据集上,检索与问答性能均持续优于当前先进方法。代码已公开。
原文摘要 · Abstract (English)
Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However, existing RAG methods for simple and multi-hop question answering (QA) are still prone to incorrect retrievals and hallucinations. To address these limitations, we propose CoopRAG, a novel RAG framework for the question answering task in which a retriever and an LLM work cooperatively with each other by exchanging informative knowledge, and the earlier and later layers of the retriever model work cooperatively with each other to accurately rank the retrieved documents relevant to a given query. In this framework, we (i) unroll a question into sub-questions and a reasoning chain in which uncertain positions are masked, (ii) retrieve the documents relevant to the question augmented with the sub-questions and the reasoning chain, (iii) rerank the documents by contrasting layers of the retriever, and (iv) reconstruct the reasoning chain by filling the masked positions via the LLM. Our experiments demonstrate that CoopRAG consistently outperforms state-of-the-art QA methods on three multi-hop QA datasets as well as a simple QA dataset in terms of both the retrieval and QA performances. Our code is available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。