arXiv:2608.03487cs.DBcs.AI2026-08

自动寻找RAG系统在性能与质量间的最佳平衡点。

RAG-Stack: Co-Optimizing RAG Serving Performance and Quality

论文配图:RAG-Stack: Co-Optimizing RAG Serving Performance and Quality
图 1 · 摘自论文原文
  • 通过迭代搜索算法自动探索不同RAG配置组合。
  • 相比现有方法,覆盖更广的质量-性能优化空间(提升52.5%~153.2%)。
  • 适合需要高效部署RAG系统的工程师和研究者使用。

检索增强生成(RAG)通过从数据库中检索信息来增强大语言模型的生成能力,已成为知识密集型应用的主流方法。然而,现代RAG系统涉及大量可配置项,如检索索引、模型选择及调用方式,每种配置都会在答案质量与服务性能间产生不同权衡,难以为特定应用场景选择最优设置。我们提出RAG-Stack框架,用于高效发现跨多样化RAG应用与服务系统的质量-性能帕累托前沿。该框架包含RAG-PE(迭代设计空间探索算法)、RAG-IR(多样化RAG算法的工作负载抽象)和RAG-CM(预测给定硬件上最优部署与服务性能的性能模型)。三者协同使RAG-Stack能在不部署每个候选配置的前提下搜索联合算法-系统配置空间,并将已有帕累托前沿迁移至新服务系统。在相同优化迭代次数下,RAG-Stack发现的帕累托前沿比现有最优配置搜索方法覆盖了52.5%至153.2%更多的归一化质量-性能空间。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG), which augments large language model (LLM) generation with information retrieved from databases, has become a widely used approach for knowledge-intensive applications. Modern RAG systems, however, expose many configuration choices, such as retrieval indexes, model selections, and how models invoke retrieval. Each configuration yields a different trade-off between answer quality and serving performance, making it challenging to choose the optimal setting for a specific application deployment. We present RAG-Stack, a framework for efficiently discovering quality-performance Pareto frontiers across diverse RAG applications and serving systems. RAG-Stack consists of RAG-PE, an iterative design-space exploration algorithm that selects the next RAG configuration to evaluate; RAG-IR, a workload abstraction for diverse RAG algorithms; and RAG-CM, a performance model that predicts the optimal deployment and serving performance on the given hardware. Together, these components allow RAG-Stack to search the joint algorithm-system configuration space without deploying every candidate and to transfer an existing Pareto frontier to a new serving system. Given the same number of optimization iterations across diverse datasets, the Pareto frontiers found by RAG-Stack cover 52.5% to 153.2% more of the normalized quality-performance space than those found by state-of-the-art configuration-search methods evaluated over the same RAG design space.

RAG性能优化系统设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。