arXiv:2510.13217cs.IRcs.LG2025-10被引 2

用大模型直接导航搜索索引,解决复杂推理查询的召回难题。

LLM-guided Hierarchical Search for End-to-end Reasoning Intensive Retrieval

  • 大模型构建分层索引,通过摘要判断文档层级相关性。
  • 在BRIGHT基准上达46.7 nDCG@10,媲美微调集成模型。
  • 不依赖嵌入模型,适合开放权重大模型与传统检索任务。

搜索系统越来越多用于需要推理的查询,其相关性需理解查询与文档间深层关系,而非仅靠词汇或主题相似性。标准流程——廉价嵌入检索器搭配大模型验证——仅在嵌入模型将正确文档置于前k位时有效,而近期推理密集型信息检索基准显示,即使最先进的嵌入模型也常失败。现有查询端改进如查询重写和代理循环虽将大模型前置,但仍受嵌入模型失效及大模型知识局限影响。本文提出全新范式:大模型引导的分层搜索,让大模型直接通过分层可导航索引访问语料库,搜索时不依赖嵌入模型。我们提出LATTICE,包含两项技术贡献:(i) 使用大模型对多级文档摘要进行评判,自顶向下构建搜索索引;(ii) 采用校准路径聚合的大模型遍历策略,通过跨分支参考节点缓解噪声和榜单依赖的评分问题。在推理密集型的BRIGHT基准上,基础版LATTICE(单个现成大模型)取得46.7 nDCG@10,达到最优微调集成基线水平;轻量级集成版LATTICE++融合检索结果达49.1 nDCG@10。同大模型对比实验表明,滑动窗口重排序在低令牌预算下更优,但LATTICE在中等预算后收敛至更高上限。LATTICE亦适用于开源大模型,并在传统检索基准(NQ、SciFact、SciDocs)上保持竞争力。

原文摘要 · Abstract (English)

Search systems are increasingly used for reasoning-intensive queries, where what makes a document relevant requires understanding or reasoning over the query-document relation rather than relying on surface vocabulary or topical similarity. The standard recipe - a cheap embedding-based retriever followed by an LLM verifier - works only when the embedding model places the right documents in its top-k, an assumption that recent reasoning-intensive IR benchmarks show often fails to hold even for SOTA embedding models. Recent query-side fixes such as query rewriting and agentic loops keep the LLM upstream of the cheap retriever and remain brittle to the embedder's failures and to the LLM's ability to rewrite the query from its parametric knowledge. In this paper, we explore a different paradigm - LLM-guided hierarchical search - in which an LLM interacts with the corpus directly via a hierarchically navigable search index, with no embedding model in the loop at search time. We propose LATTICE, an instantiation with two technical contributions: (i) a top-down LLM-guided construction of the search index using LLM judgements over multi-level document summaries, and (ii) a calibrated, path-aggregated LLM-guided traversal that mitigates noisy, slate-dependent LLM scores via cross-branch reference nodes. On the reasoning-intensive BRIGHT benchmark, base LATTICE with a single off-the-shelf LLM achieves 46.7 nDCG@10 - matching the best fine-tuned ensemble baseline overall - and a lightweight ensemble LATTICE++ that fuses LATTICE with cheap retrieval reaches 49.1 nDCG@10. A controlled same-LLM comparison against sliding-window reranking shows reranking offers a better tradeoff at low token budgets, but LATTICE converges to a higher asymptote after a moderate budget. LATTICE also works with open-weight LLMs and remains competitive on traditional IR benchmarks (NQ, SciFact, SciDocs).

大模型检索分层搜索推理增强信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。