arXiv:2606.28365cs.IRcs.AI2026-06中稿 · ACM CAIS 2026

用智能代理筛选高效语义索引组合,省钱省时还提效果。

CAMI: Cost-Aware Agent-Guided Multi-Indexing for Semantic Retrieval

论文配图:CAMI: Cost-Aware Agent-Guided Multi-Indexing for Semantic Retrieval
图 1 · 摘自论文原文
  • 用代理自动发现适合文档的语义表示模板
  • 在严格预算下找到召回率最高索引组合,最高提升9.4%
  • 比随机搜索少用5倍预算,适合真实系统部署

RAG数据摄入流程常通过生成合成查询或摘要等语义增强索引来提升检索效果,但这类索引的构建面临组合爆炸问题,且评估成本随语料规模线性增长。本文提出CAMI(成本感知多索引框架),将多索引构建建模为带预算约束的多目标组合优化问题。CAMI包含三个核心机制:(i) 代理发现阶段生成针对特定语料的表示模板;(ii) 原子单元搜索评估单个增强模型对,并通过保真度局部闭包重组识别协同组合;(iii) 信心感知推广策略提前剔除低效配置,实现优化开销与语料规模解耦。在多种语料上评估显示,CAMI能在严格预算下系统性识别高召回组合,在挑战性场景中相较纯内容基线最高提升9.4% recall@10。同时,其仅需随机搜索1/5的预算即可达成类似效果,显著提升实际生产可用性。

原文摘要 · Abstract (English)

RAG ingestion pipelines frequently augment search corpus index with semantic enrichment indices (e.g., synthetic queries or summaries generated from corpus chunks) that are subsequently queried alongside the base index to improve retrieval via better alignment between document representations and user intent. While these supplementary representations substantially improve retrieval quality, they introduce a computational bottleneck: the configuration space of enrichment types and generator models is combinatorial, and the cost of exhaustive index-time evaluation scales linearly with corpus size. We introduce CAMI (Cost-Aware Multi-Indexing), a framework that formalizes multi-index construction as a budgeted, multi-objective portfolio selection problem. CAMI targets the upstream decision of which enrichment views to generate and materialize before the retrieval backend is applied. CAMI incorporates three primary mechanisms: (i) an agentic discovery phase that proposes corpus-specific representation templates; (ii) an atomic-unit search procedure that evaluates individual enrichment-model pairs and recombines them via fidelity-local closure to identify synergistic portfolios; and (iii) a confidence-aware promotion schedule that prunes unpromising configurations early, decoupling optimization spend from total corpus size. We evaluate CAMI across diverse retrieval corpora. Our findings reveal that the framework systematically isolates high-recall portfolios under strict budget constraints, outperforming standard content-only baselines in challenging settings by up to 9.4% recall@10. Further, CAMI is able to systematically identify these high-recall portfolios using up to 5x less budget compared to random search baselines, making our approach practical in real production scenarios.

检索增强多索引成本优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。