让检索代理像专家一样一次精准定位信息,减少多次尝试。
Superintelligent Retrieval Agent: The Next Frontier of Agentic Retrieval
- 用术语区分度代替盲目搜索,单次完成高效检索
- 在10个BEIR基准上超越密集/稀疏检索器和大模型代理
- 适合需要低延迟高召回的智能检索系统研发
检索增强型代理日益成为访问大型知识库的接口,但多数将其视为黑箱:通过试探性查询、查看片段并不断重述来寻找证据。这类似于新手摸索陌生数据库,而非专家凭借对术语和潜在证据的强先验知识进行导航,导致额外的检索轮次、延迟和召回不足。我们提出超智能检索代理(SIRA),将‘超智能’概念应用于检索,旨在将多轮探索性搜索压缩为一次具有文档集区分性的检索动作。SIRA 不仅判断哪些术语相关,更识别哪些术语能将目标证据与整体语料库中的混淆项区分开。离线阶段,使用大模型为每篇文档补充缺失的搜索词汇;查询时,预测查询中遗漏的证据词汇;利用语料库统计作为工具调用,过滤掉不存在、过于常见或难以产生检索优势的词汇。最终通过一次加权 BM25 调用,结合查询与验证后的扩展词完成检索。在10个BEIR基准上,SIRA达到最高平均检索性能,优于密集检索器、学习型稀疏检索器及大模型检索代理基线,且无需相关性标签或检索器微调。在下游问答任务中,其仅依赖检索的答案覆盖率达9.70% Recall@1,15.27% Recall@10,36.14% Recall@100,超过近期强化学习训练的智能问答系统。我们还引入了新基准BrowseComp-Wikipedia,包含232个来自BrowseComp的复杂查询,覆盖25,587,229篇维基百科文档。即使不进行索引期扩充,仅基于接地的维基百科类别,SIRA在所有预算下均优于多轮Perplexity代理。
原文摘要 · Abstract (English)
Retrieval-augmented agents are increasingly the interface to large knowledge bases, yet most treat retrieval as a black box: they issue exploratory queries, inspect snippets, and reformulate until evidence emerges. This resembles how a newcomer searches an unfamiliar database rather than how an expert navigates it with strong priors about terminology and likely evidence, causing extra retrieval rounds, latency, and poor recall. We introduce \textit{Superintelligent Retrieval Agent} (SIRA), which casts \emph{superintelligence} in retrieval as compressing multi-round exploratory search into a single corpus-discriminative retrieval action. SIRA does not merely ask which terms are relevant; it asks which terms separate the desired evidence from corpus-level confusers. Offline, an LLM enriches each document with missing search vocabulary; at query time, it predicts evidence vocabulary the query omits; and corpus statistics serve as tool calls that filter terms that are absent, overly common, or unlikely to create retrieval margin. The final step is a single weighted BM25 call combining the query with the validated expansion. Across ten BEIR benchmarks, SIRA achieves the strongest average retrieval performance in our comparison, beating dense retrievers, learned sparse retrievers, and LLM search-agent baselines while using no relevance labels or retriever fine-tuning. On downstream QA, its retrieval-only answer coverage exceeds recent RL-trained agentic QA systems on NQ and HotpotQA. We also introduce \textbf{BrowseComp-Wikipedia}, a hard-search benchmark of 232 BrowseComp-derived queries over a 25,587,229-document Wikipedia index. Even without index-time enrichment, using only grounded Wikipedia categories, SIRA outperforms multi-round Perplexity agents at every budget, reaching 9.70% Recall@1, 15.27% Recall@10, and 36.14% Recall@100.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。