arXiv:2606.14932cs.IR2026-06

剖析工业级检索服务架构,揭示真实场景下的系统设计权衡。

Retrieval-as-a-Service:A System-Oriented Analysis of Industrial Retrieval Pipelines in Web Systems

  • 将检索流程抽象为多阶段服务架构,涵盖候选生成、语义匹配与资源感知重排。
  • 实测表明大模型检索提升语义效果但增加延迟与计算开销。
  • 适合关注大规模系统性能优化与服务化部署的工程师与架构师。

检索系统已成为现代网络服务的基础组件,支撑内容推荐、广告投放和API发现等应用。在大规模工业环境中,检索正越来越多地以独立服务层形式部署,即检索即服务(RaaS)。本文从系统视角对工业级检索流水线进行调研,聚焦实际约束下的架构设计与部署权衡。不同于以往侧重算法进展的综述,本研究从基础设施角度出发,揭示延迟要求、可扩展性限制与资源瓶颈如何影响生产环境中的系统设计。我们提出统一的RaaS流水线抽象,将检索建模为包含高效候选生成、基于嵌入的语义匹配及资源感知重排的多阶段服务。进一步分析了大语言模型(LLM)在检索中的集成及其对语义性能、延迟与计算开销的影响。研究结果为服务化检索基础设施提供了系统级理解,并为大规模网络系统中可扩展、高效且服务质量(QoS)感知的检索架构设计提供实践指导。

原文摘要 · Abstract (English)

Retrieval systems have become a foundational infrastructure component in modern Web services, supporting applications such as content recommendation, advertising targeting, and API discovery. In large-scale industrial environments, retrieval is increasingly deployed as an independent service layer, commonly referred to as Retrieval-as-a-Service (RaaS). This paper presents a system-oriented survey of industrial retrieval pipelines, focusing on architectural design and deployment trade-offs under real-world constraints. Unlike prior surveys that emphasize algorithmic developments, we analyze retrieval systems from an infrastructure perspective, highlighting how latency requirements, scalability constraints, and resource limitations shape system design in production environments. We introduce a unified RaaS pipeline abstraction that models retrieval as a multi-stage service, including high-efficiency candidate generation, embedding-based semantic matching, and resource-aware re-ranking. We further examine the integration of Large Language Model (LLM)-based retrieval mechanisms and analyze their impact on semantic performance, latency, and computational overhead. The results provide a system-level understanding of retrieval as a service-oriented infrastructure and offer practical guidelines for designing scalable, efficient, and QoS-aware retrieval architectures in large-scale Web systems.

检索系统服务化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。