arXiv:2509.04820cs.IR2025-09被引 2

对比单次与迭代检索,提升法律文档问答的准确率

Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation

  • 单次检索按令牌预算自适应选块,扩大上下文覆盖
  • 迭代检索通过推理代理多轮优化,提升答案质量
  • 针对查询漂移和检索惰性设计优化模块,适合法律领域应用

基于大语言模型的检索增强生成(RAG)是理解与查询行业闭源文档的强大方案。然而,基础RAG在法律与监管领域复杂问答任务中常表现不佳,尤其面对大量政府文件时,顶-k策略常遗漏关键段落,导致回答不完整或错误。为解决这一检索瓶颈,本文探索两种策略:一是单次检索方法,根据令牌预算自适应选择段落,尽可能在模型上下文窗口内包含相关文本,并设计模块进一步过滤与精炼;二是基于推理智能体的迭代检索框架,由推理型LLM动态生成搜索查询、评估结果并多轮迭代优化上下文。我们识别出查询漂移与检索惰性问题,并针对性设计两个模块加以缓解。在政府文档数据集上开展广泛实验,旨在为法律与监管领域的实际应用提供可行洞见与指导。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and regulatory domains, particularly when dealing with numerous government documents. The top-$k$ strategy frequently misses golden chunks, leading to incomplete or inaccurate answers. To address these retrieval bottlenecks, we explore two strategies to improve evidence coverage and answer quality. The first is a One-SHOT retrieval method that adaptively selects chunks based on a token budget, allowing as much relevant content as possible to be included within the model's context window. Additionally, we design modules to further filter and refine the chunks. The second is an iterative retrieval strategy built on a Reasoning Agentic RAG framework, where a reasoning LLM dynamically issues search queries, evaluates retrieved results, and progressively refines the context over multiple turns. We identify query drift and retrieval laziness issues and further design two modules to tackle them. Through extensive experiments on a dataset of government documents, we aim to offer practical insights and guidance for real-world applications in legal and regulatory domains.

检索增强法律AI大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。