arXiv:2604.26981cs.IRcs.LG2026-04被引 1

提出按块计费的检索增强生成模型,更省钱更透明。

Budget-Constrained Online Retrieval-Augmented Generation: The Chunk-as-a-Service Model

论文配图:Budget-Constrained Online Retrieval-Augmented Generation: The Chunk-as-a-Service Model
图 1 · 摘自论文原文
  • 按检索片段质量与成本动态选块,实时优化预算
  • 比随机选块多提升52%效果,接近离线最优水平
  • 适合预算敏感场景,尤其适合大规模应用

大语言模型在自然语言处理中取得突破,但存在幻觉和缺乏来源透明等问题。检索增强生成(RAG)被提出以缓解此问题。现有RAG即服务(RaaS)模式按请求次数收费,未考虑检索片段的质量或相关性,导致成本不透明且效率低。本文提出按块计费(CaaS)模型,包含开放预算与受限预算两种变体,依托“效用-成本在线选择算法”(UCOSA)。UCOSA 在线评估并筛选部分请求,基于预算约束与效用-成本权衡进行片段增强。实验表明,在性能指标(增强请求数×平均相关性)上,UCOSA 比随机选择高约52%,达到离线最优方法的约75%。在预算利用率方面,受限预算与开放预算版本分别实现140%和86%的性能-预算比,显著优于RaaS。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have revolutionized the field of natural language processing. However, they exhibit some limitations, including a lack of reliability and transparency: they may hallucinate and fail to provide sources that support the generated output. Retrieval-Augmented Generation (RAG) was introduced to address such limitations in LLMs. One popular implementation, RAG-as-a-Service (RaaS), has shortcomings that hinder its adoption and accessibility. For instance, RaaS pricing is based on the number of submitted prompts, without considering whether the prompts are enriched by relevant chunks, i.e., text segments retrieved from a vector database, or the quality of the utilized chunks (i.e., their degree of relevance). This results in an opaque and less cost-effective payment model. We propose Chunk-as-a-Service (CaaS) as a transparent and cost-effective alternative. CaaS includes two variants: Open-Budget CaaS (OB-CaaS) and Limited-Budget CaaS (LB-CaaS), which is enabled by our ``Utility-Cost Online Selection Algorithm (UCOSA)''. UCOSA further extends the cost-effectiveness and the accessibility of the OB-CaaS variant by enriching, in an online manner, a subset of the submitted prompts based on budget constraints and utility-cost tradeoff. Our experiments demonstrate the efficacy of the proposed UCOSA compared to both offline and relevance-greedy selection baselines. In terms of the performance metric-the number of enriched prompts (NEP) multiplied by the Average Relevance (AR)-UCOSA outperforms random selection by approximately 52% and achieves around 75% of the performance of offline selection methods. Additionally, in terms of budget utilization, LB-CaaS and OB-CaaS achieve higher performance-to-budget ratios of 140% and 86%, respectively, compared to RaaS, indicating their superior efficiency.

检索增强成本优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。