用图迭代重排提升复杂查询召回率,成本低效果好
Reproducing Adaptive Reranking for Reasoning-Intensive IR
- 通过构建语料图并迭代探索,改进重排过程以突破召回瓶颈
- 在BRIGHT数据集上显著提升各类模型的推理型检索效果
- 无需复杂训练,适合需要高效处理复杂查询的系统部署
传统检索-重排流水线受限于第一阶段检索器,存在召回上限问题。现有方法多通过优化第一阶段检索器缓解此问题,但代价高昂,尤其在需深度推理的查询场景下。为避免基于推理的检索器带来的计算开销,本文复现了图结构自适应重排(GAR)在BRIGHT推理型检索基准上的表现。GAR通过迭代探索语料图来修改重排过程,此前仅验证于主题和问答类查询。本研究将其应用于推理与非推理型重排模型,在推理密集型场景中发现:重排器信号质量对识别额外相关文档至关重要。结果表明,GAR在多种模型上均有效提升推理型检索性能,且计算开销极小。该工作推动了可实用的推理型检索系统部署。
原文摘要 · Abstract (English)
The classical cascading pipeline of retrieve--rerank suffers from a bounded recall problem, stemming from limitations of the first-stage retriever. Most current approaches address the bounded recall problem by improving the first-stage retriever, but this incurs substantial training and inference costs, especially to handle queries that require substantial reasoning. To circumvent the computational costs of reasoning-based retrievers, we replicate the findings of GAR, Graph-based Adaptive Reranking, on the BRIGHT reasoning-intensive retrieval benchmark. GAR addresses the bounded recall problem by modifying the reranking process itself through iterative exploration of a corpus graph, but it was previously only tested on models designed for topical and question-answering-style queries. Hence, reproduce GAR in reasoning-intensive settings with reasoning and non-reasoning reranking models. We observe that the quality of the reranker's signal plays an important role in identifying additional relevant documents within the corpus graph. Overall, we find that GAR boosts the effectiveness of reasoning-intensive retrieval across a variety of models while contributing minimally to computational overheads. Ultimately, this work enables more practical deployment of retrieval systems that can address reasoning-intensive queries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。