用大模型生成假文档做搜索加速,省下大量计算却不影响效果。
Generate to Accelerate: Improved Reranking via LLM-Generated Pivot Documents

- 用大模型生成与查询相关的伪文档作筛选枢纽。
- 点对点重排序推理量减少66%,列表式重排序提速最高2.95倍。
- 适合需要快速检索的场景,尤其对资源有限的系统有帮助。
传统重排序加速方法通常依赖文档集合中已有文档进行候选集筛选或构建比较图,以减少冗余计算。对于点对点重排序,通常基于顶部文档得分设定查询相关阈值;而列表式方法则多采用启发式策略,如滑动窗口内局部比较传播或自顶向下基于枢纽的简化比较。本文认为,这些过程无需局限于真实文档。我们提出利用大语言模型为给定查询生成伪相关文档,并在此基础上改进现有重排序方法,还设计了一种新的并行重排序策略,将该生成文档作为枢纽。实验表明,使用大模型生成的枢纽进行排名列表截断,可使点对点重排序的推理次数减少高达66%;在域内和域外设置下,列表式重排序速度提升最高达2.95倍,同时保持相当或更优的检索效果。
原文摘要 · Abstract (English)
Common approaches to reduce the computational overhead of reranking models include identifying a candidate set of documents for reranking or constructing comparison graphs to minimize redundant comparisons. For pointwise rankers, determining a candidate set typically involves estimating a query-dependent cutoff based on the scores of the top-ranked documents. In contrast, comparison graphs for listwise approaches are often derived using heuristics, such as propagating local comparisons within sliding windows in a bottom-up fashion or reducing comparisons via pivot-based strategies in a top-down manner. In this work, we argue that restricting these processes to existing documents in the collection is unnecessary. Instead, we propose leveraging the generative capabilities of large language models to synthesize a pseudo-relevant document for a given query. We then adapt existing reranking approaches and also propose a novel parallel reranking approach to leverage this LLM-generated document as a pivot. Our experiments demonstrate that using LLM-generated pivots for ranked list truncation reduces the number of pointwise ranker inferences by up to 66\%. In both in-domain and out-of-domain settings, we observe speedups of up to $2.95\times$ in listwise reranking, while maintaining comparable or improved retrieval effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。