无需预索引,动态文档中高效定位相关证据。
LENS: In-Context Search via Latent Evidence Exploration over Dynamic Raw Documents
- 基于查询动态构建证据信念,迭代筛选候选单元。
- 在500题测试中准确率62.4%,证据召回率达84.8%。
- 适合需快速响应文档变更的实时问答场景。
大语言模型代理越来越多地在动态原始文档集合上回答问题,其中文件可能在预处理前发生改变,且相关证据(段落、章节、页面或表格)依赖于具体查询。现有检索增强方法通过固定切块、嵌入或持久索引预先实体化证据空间:虽利于查找,但代价高、易过时,且在查询前即确定粒度。本文将上下文搜索建模为在由动态原始文档诱导的潜在证据空间中的预算化证据定位问题,并提出LENS(Latent Evidence Exploration and Search)——一种无索引框架。不预先实体化证据空间,而是在查询条件下维护候选单元的信念,通过互补的词汇、局部和探索性提议策略迭代选择候选,利用大语言模型作为相关性判断器更新信念,在可控预算下逐步聚焦高后验区域。证据被整合为紧凑、源文本锚定的感兴趣区域,并压缩为可跨相关查询复用的自组织知识簇。在500题受控评估中,与基准的ReAct风格方法相比,LENS达到62.4%精确匹配率和84.8%证据召回率(后者为65.2%精确匹配率但50.4%证据召回率)。在150题全维基子集上,无索引条件下,两者答案质量接近(43.3% vs. 42.7% EM),但LENS更注重证据溯源(84.0% vs. 70.7%)。封闭书参考凸显了模型记忆的作用。LENS在文档变更后无需预处理即可直接使用,无需持久索引,全程保持源文本锚定的证据定位。
原文摘要 · Abstract (English)
LLM agents increasingly answer questions over dynamic raw-document collections, where files may change before preprocessing, and relevant evidence (spans, sections, pages, or tables) is query-dependent. Existing retrieval-augmented approaches pre-materialize evidence via fixed chunking, embeddings, or persistent indexes: effective for lookup, yet costly, stale-prone, and committed to a granularity before the query is known. We formulate in-context search as Budgeted Evidence Localization over a latent evidence space induced by dynamic raw documents and propose LENS (Latent Evidence Exploration and Search), an index-free framework. Instead of pre-materializing the evidence space, LENS maintains a query-conditioned belief over candidate units, iteratively selecting candidates via complementary lexical, local, and exploratory proposal policies, updating the belief via an LLM relevance oracle, and narrowing toward high-posterior regions under a controllable budget. Evidence is consolidated into compact, source-grounded regions of interest and compressed into self-organizing knowledge clusters reused across related queries. On a controlled 500-question evaluation with matched corpus snapshots, LENS reaches 62.4% exact match and 84.8% evidence recall vs. 65.2% exact match but 50.4% evidence recall for a ReAct-style baseline. Across scales, LENS gives the strongest supporting-fact localization and answer grounding. On a fixed 150-question fullwiki subset over the raw Wikipedia dump with zero indexing, LENS and ReAct are nearly tied in official answer quality (43.3% vs. 42.7% EM), with LENS grounding more answers in retrieved evidence (84.0% vs. 70.7%). A no-retrieval Closed-Book reference highlights the contribution of model memory. LENS is query-ready after corpus changes, needs no preprocessing or persistent index, and preserves source-grounded evidence localization throughout.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。