arXiv:2510.13329cs.CL2025-10中稿 · ICLR

轻量级重排序框架,提升跨段落推理的检索准确率

Embedding-Based Context-Aware Reranker

  • 基于嵌入的结构化注意力机制,增强跨段落理解
  • 在ConTEB上优于现有方法,精度更高且推理更快
  • 适合需要跨文档推理的复杂问答任务

检索增强生成(RAG)系统依赖从语料库中检索相关证据以支持下游生成。将长文档切分为多个短段落虽能实现更细粒度的精准检索,但也带来跨段落推理难题,如指代消解、实体消歧和分散证据聚合。尽管当前先进重排序方法使用强大的预训练语言模型,但往往忽略这些挑战。为此,我们提出嵌入式上下文感知重排序器(EBCAR),一种直接在检索段落嵌入上运行的轻量级框架,通过段落结构信息与混合注意力机制,捕捉文档间高层交互与文档内低层关系。在ConTEB基准上的实验表明,EBCAR在需跨段落推理的信息检索任务中表现优异,在准确率和效率上均具优势。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) systems rely on retrieving relevant evidence from a corpus to support downstream generation. The common practice of splitting a long document into multiple shorter passages enables finer-grained and targeted information retrieval. However, it also introduces challenges when a correct retrieval would require inference across passages, such as resolving coreference, disambiguating entities, and aggregating evidence scattered across multiple sources. Many state-of-the-art (SOTA) reranking methods, despite utilizing powerful large pretrained language models with potentially high inference costs, still neglect the aforementioned challenges. Therefore, we propose Embedding-Based Context-Aware Reranker (EBCAR), a lightweight reranking framework operating directly on embeddings of retrieved passages with enhanced cross-passage understandings through the structural information of the passages and a hybrid attention mechanism, which captures both high-level interactions across documents and low-level relationships within each document. We evaluate EBCAR against SOTA rerankers on the ConTEB benchmark, demonstrating its effectiveness for information retrieval requiring cross-passage inference and its advantages in both accuracy and efficiency.

重排序跨段落推理RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。