提出新型检索系统架构,融合多模型实现更高效精准的排序
Optimizing Compound Retrieval Systems
- 用多模型协同替代传统分阶段重排序,支持更灵活的模型交互
- 结合BM25与大语言模型,优化后在效果与效率上优于传统方法
- 适合需要高精度且资源受限的检索场景,如企业级搜索系统
现代检索系统通常不依赖单一排序模型,而是采用级联式多阶段重排序,通过限制每轮模型处理文档数量,在排名质量与计算成本间取得平衡。然而,级联并非唯一模型交互方式。本文提出‘复合检索系统’这一更广泛的检索系统范式,允许多种预测模型以多样化方式协作,不仅包含级联结构,还支持大语言模型(LLM)参与相对相关性判断等新型交互。本研究聚焦于复合系统的优化设计,核心在于学习何时应用组件模型以及如何聚合其预测结果形成最终排序。实验表明,该方法可有效融合经典BM25与前沿成对式LLM相关性预测,在优化特定排序指标和效率目标下,性能超越传统级联方案,即使在自监督设置下仍具优势。本工作旨在推动信息检索领域探索更创新的模型协同机制。
原文摘要 · Abstract (English)
Modern retrieval systems do not rely on a single ranking model to construct their rankings. Instead, they generally take a cascading approach where a sequence of ranking models are applied in multiple re-ranking stages. Thereby, they balance the quality of the top-K ranking with computational costs by limiting the number of documents each model re-ranks. However, the cascading approach is not the only way models can interact to form a retrieval system. We propose the concept of compound retrieval systems as a broader class of retrieval systems that apply multiple prediction models. This encapsulates cascading models but also allows other types of interactions than top-K re-ranking. In particular, we enable interactions with large language models (LLMs) which can provide relative relevance comparisons. We focus on the optimization of compound retrieval system design which uniquely involves learning where to apply the component models and how to aggregate their predictions into a final ranking. This work shows how our compound approach can combine the classic BM25 retrieval model with state-of-the-art (pairwise) LLM relevance predictions, while optimizing a given ranking metric and efficiency target. Our experimental results show optimized compound retrieval systems provide better trade-offs between effectiveness and efficiency than cascading approaches, even when applied in a self-supervised manner. With the introduction of compound retrieval systems, we hope to inspire the information retrieval field to more out-of-the-box thinking on how prediction models can interact to form rankings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。