SANE提升RAG性能,通过智能筛选和结构化提取解决检索与阅读失败问题。
Select-And-Extract: A Lightweight Plugin for Retrieval-Augmented Generation

- 用语义检索+大模型筛选,提升候选信息召回率
- 查询时生成结构化证据蓝图,减少大模型推理负担
- 轻量插件设计,仅小幅增加开销但显著改善效果
语言模型系统中的检索增强生成(RAG)存在两大失效模式:检索失败和阅读失败。前者无法从外部语料库中召回正确信息,后者即使信息已召回也无法生成正确答案。现有方法对检索失败采用结构化索引,但泛化能力有限;对阅读失败采用查询时结构化,但通常需大量语言模型调用且依赖模型自身能力。为此,我们提出Select-And-Extract(SANE),一种简单高效的RAG插件。针对检索失败,使用语义检索器获取大量候选,并利用大模型根据摘要筛选出最优候选,提升召回效果。针对阅读失败,采用蓝图引导的查询时证据提取,使生成模型仅处理紧凑、结构化的关键信息,从而提升推理能力。实验表明,SANE带来显著性能提升,同时仅引入少量额外开销。作为轻量级RAG插件,SANE提供了一种无需复杂架构即可实现高性能的可行方案。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) for language model (LM) systems fundamentally has two failure modes: retrieval failure and reading failure. The former fails to recall the right pieces of information from the external corpus, and the latter fails to produce the correct answer although the right information is retrieved. Some methods perform structured indexing for retrieval failure, but may suffer from limited generalization of the fixed structures. Some methods perform query-time structuring for reading failure, but typically require a lot of LM calls and rely heavily on the LM's capability. To this end, we propose Select-ANd-Extract (SANE), a simple yet effective plugin for RAG. For the retrieval failure, we retrieve a wide set of candidates with a semantic retriever, and leverage the LM to select the top candidates based on their synopses, which yields better recall than the original retriever. For the reading failure, we perform blueprint-guided query-time evidence extraction, which allows the generator LM to use only compact and structured key information so that it can perform better reasoning. Empirical results confirm that SANE brings solid improvements, while only introducing modest extra overhead. As a lightweight plugin for RAG, SANE offers a simple alternative to heavier approaches, and suggests a high-performance RAG framework need not be overly complex.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。