arXiv:2601.10644cs.IR2026-01被引 1

让复杂检索流程像调接口一样快速部署。

RoutIR: Fast Serving of Retrieval Pipelines for Retrieval-Augmented Generation

  • 封装任意检索模型为可配置的HTTP服务,支持动态组合与异步批处理。
  • 通过配置文件即可灵活搭建多阶段检索流水线,自动缓存提升效率。
  • 适合需要实时响应的RAG系统开发者,尤其支持循环、反馈等动态场景。

检索模型是检索增强生成(RAG)系统的核心组件,负责生成搜索查询、处理返回文档并生成响应。传统RAG系统常涉及多轮检索,而当前多数先进检索方法依赖学术信息检索平台,这些平台基于Cranfield范式设计,要求所有查询预先确定并可离线批量处理。这种设定虽加速研究进展,却难以支持需在线服务的下游应用,如包含循环、反馈或自组织代理的动态RAG流程。为此,本文提出RoutIR,一个轻量级Python包,提供简单高效的HTTP API,可封装任意检索方法(包括首阶段检索、重排序、查询扩展和结果融合)。仅需一个最小化的JSON配置文件指定要服务的检索模型,RoutIR即可按任意组合在线构建并查询检索流水线(例如融合多个首阶段检索结果后进行重排序)。该API默认实现异步查询批处理和结果缓存。尽管已有多种前沿检索方法被支持,用户仍可通过实现Engine抽象类轻松扩展。项目已开源,可在GitHub上获取:http://github.com/hltcoe/routir。

原文摘要 · Abstract (English)

Retrieval models are key components of Retrieval-Augmented Generation (RAG) systems, which generate search queries, process the documents returned, and generate a response. RAG systems are often dynamic and may involve multiple rounds of retrieval. While many state-of-the-art retrieval methods are available through academic IR platforms, these platforms are typically designed for the Cranfield paradigm in which all queries are known up front and can be batch processed offline. This simplification accelerates research but leaves state-of-the-art retrieval models unable to support downstream applications that require online services, such as arbitrary dynamic RAG pipelines that involve looping, feedback, or even self-organizing agents. In this work, we introduce RoutIR, a Python package that provides a simple and efficient HTTP API that wraps arbitrary retrieval methods, including first stage retrieval, reranking, query expansion, and result fusion. By providing a minimal JSON configuration file specifying the retrieval models to serve, RoutIR can be used to construct and query retrieval pipelines on-the-fly using any permutation of available models (e.g., fusing the results of several first-stage retrieval methods followed by reranking). The API automatically performs asynchronous query batching and caches results by default. While many state-of-the-art retrieval methods are already supported by the package, RoutIR is also easily expandable by implementing the Engine abstract class. The package is open-sourced and publicly available on GitHub: http://github.com/hltcoe/routir.

检索系统RAGAPI设计在线服务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。