EXIT通过上下文感知的抽取式压缩,提升RAG问答的准确率与速度。
EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation
- 基于上下文分类筛选相关句子,实现并行化高效提取。
- 在单跳和多跳问答中,准确率高于现有压缩方法甚至未压缩基线。
- 适合需要低延迟高精度问答的系统,尤其适用于检索质量不稳定的场景。
我们提出EXIT,一种抽取式上下文压缩框架,用于增强问答任务中检索增强生成(RAG)的有效性与效率。当前RAG系统在检索模型未能正确排序最相关文档时,常因引入过多上下文而增加延迟并降低准确率。虽然抽象式压缩可大幅减少令牌数,但其逐标记生成过程显著增加端到端延迟;而现有抽取式方法依赖独立且非自适应的句子选择,无法充分利用上下文信息。EXIT通过分类检索文档中的句子,同时保留其上下文依赖关系,实现可并行、上下文感知的自适应抽取,适应查询复杂度与检索质量。我们在单跳和多跳问答任务上的评估显示,EXIT在保持高准确率的同时,显著降低推理时间与令牌数量,优于现有压缩方法甚至未压缩基线。该方法为构建可扩展、高质量的RAG问答系统提供了新方向。代码已开源:https://github.com/ThisIsHwang/EXIT。
原文摘要 · Abstract (English)
We introduce EXIT, an extractive context compression framework that enhances both the effectiveness and efficiency of retrieval-augmented generation (RAG) in question answering (QA). Current RAG systems often struggle when retrieval models fail to rank the most relevant documents, leading to the inclusion of more context at the expense of latency and accuracy. While abstractive compression methods can drastically reduce token counts, their token-by-token generation process significantly increases end-to-end latency. Conversely, existing extractive methods reduce latency but rely on independent, non-adaptive sentence selection, failing to fully utilize contextual information. EXIT addresses these limitations by classifying sentences from retrieved documents - while preserving their contextual dependencies - enabling parallelizable, context-aware extraction that adapts to query complexity and retrieval quality. Our evaluations on both single-hop and multi-hop QA tasks show that EXIT consistently surpasses existing compression methods and even uncompressed baselines in QA accuracy, while also delivering substantial reductions in inference time and token count. By improving both effectiveness and efficiency, EXIT provides a promising direction for developing scalable, high-quality QA solutions in RAG pipelines. Our code is available at https://github.com/ThisIsHwang/EXIT
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。