arXiv:2607.05764cs.CLcs.IR2026-07

用高效检索替代全文档注入,显著降低大模型法律文本分析的计算成本。

Inject or Navigate? Token-Efficient Retrieval for LLM Analysis of Transactional Legal Documents

  • 通过结构化分块与嵌入检索或大模型导航,实现低耗精准问答
  • 在18个文档相关问题上,90%以上与全量注入效果持平,输入tokens减少17.3倍
  • 导航模式总开销降低56倍,成本下降25%,适合高并发法律场景

在事务性法律文档中回答问题,传统做法是将整个文档集注入大模型上下文,虽召回率高但消耗大量token且受长上下文性能下降影响。本文对比了两种结构化检索方案:基于嵌入的检索(NAVEMBED)和基于紧凑结构索引的大模型导航(NAVINDEX)。在包含20个问题的基准测试中,经位置偏差控制与参考锚定评分,重排序后的语义检索在18个文档相关问题中与全量注入持平(16次持平,2次偏好注入),仅需17.3倍更少的输入token(通用嵌入配置达29.9倍,但持平率更低);两者在2个超出范围问题上也表现相当。NAVINDEX在全部18个问题上与注入持平,总token开销仅1.61倍,回答上下文缩小56倍,成本降低25%。推导出缓存注入的闭式交叉规则:当文档总量低于检索负载的十倍时,缓存注入才更经济。第8节量化了适用范围与不确定性。

原文摘要 · Abstract (English)

Answering questions over a set of transactional legal documents is most simply done by injecting the whole corpus into the LLM's context window on every query. That baseline maximises retrieval recall, but its token footprint scales with the corpus rather than the question, and long-context degradation scales with it. We report what it took to replace full-corpus injection in a legal-document analysis system, comparing it against two structured retrieval modes over our proprietary structure-aware chunking: embedding retrieval (NAVEMBED) and LLM navigation over a compact structured index (NAVINDEX). On a 20-question benchmark with verified ground-truth answers, a position-bias-controlled, reference-anchored pairwise judge scored semantic retrieval with reranking tied with injection on 16 of 18 document-bound questions (injection preferred on 2) while attending to 17.3x fewer input tokens (a general-text-embedding (GTE) configuration reaches 29.9x at a lower tie rate); both modes were judged tied on the 2 out-of-scope controls. NAVINDEX was judged tied on all 18 at a 1.61x smaller total token footprint, a ~56x smaller answering context, and 25% lower dollar cost. We derive a closed-form caching-crossover rule: cached injection is cheaper in dollars only while the corpus stays below roughly ten times the retrieval payload. Scope and uncertainty are quantified in Section 8.

大模型法律AI检索优化低耗推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。