优化RAG检索环节，发现降低搜索精度可提升速度与效率
Toward Optimal Search and Retrieval for RAG
- 通过实验分析检索器与生成器的协同关系
- 降低检索精度对问答任务影响小，但能显著提速省内存
- 适合追求高效部署的RAG系统开发者
检索增强生成（RAG）是应对大语言模型（LLM）记忆挑战的有前景方法。RAG管道由检索器和阅读器两个独立组件构成，但二者对下游任务性能的影响尚不明确。本文聚焦于常见问答（QA）任务，研究检索与RAG性能之间的关系，揭示若干对实践者有价值的洞察。例如，适度降低检索精度对RAG性能影响微小，却可能大幅提升检索速度并增强内存效率，为构建高性能RAG系统提供关键优化方向。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the impact of each on downstream task performance is not well-understood. Here, we work towards the goal of understanding how retrievers can be optimized for RAG pipelines for common tasks such as Question Answering (QA). We conduct experiments focused on the relationship between retrieval and RAG performance on QA and attributed QA and unveil a number of insights useful to practitioners developing high-performance RAG pipelines. For example, lowering search accuracy has minor implications for RAG performance while potentially increasing retrieval speed and memory efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。