arXiv:2508.07995cs.IRcs.AI2025-08被引 36

DIVER通过多阶段设计提升复杂推理型检索效果。

DIVER: A Multi-Stage Approach for Reasoning-intensive Information Retrieval

  • 分四阶段处理:预处理、查询扩展、精调模型检索、混合重排序。
  • 在BRIGHT基准上,原始查询nDCG@10达31.9,整体达46.8,领先现有模型。
  • 适合需要深度推理的医疗与数学类问答任务,尤其擅长抽象思维场景。

检索增强生成在依赖直接词汇或语义匹配的知识密集型任务中表现优异。然而,许多真实查询涉及抽象推理、类比思维或多步推断,现有检索器难以捕捉。为此,我们提出DIVER,一种面向推理密集型信息检索的多阶段管道。包含四个组件:文档预处理阶段通过清理噪声文本和分割长文档提升可读性;查询扩展阶段利用大语言模型迭代优化用户查询,融入显式推理与检索文档中的证据;检索阶段采用在医学与数学领域合成数据上微调的模型,并引入困难负样本,有效应对推理型查询;重排序阶段结合点对点与列表级策略,生成细粒度且全局一致的排名。在BRIGHT基准上,DIVER整体nDCG@10达到46.8,原始查询达31.9,持续优于竞争性推理感知模型。结果表明,推理感知检索策略在复杂现实任务中具有显著有效性。

原文摘要 · Abstract (English)

Retrieval-augmented generation has achieved strong performance on knowledge-intensive tasks where query-document relevance can be identified through direct lexical or semantic matches. However, many real-world queries involve abstract reasoning, analogical thinking, or multi-step inference, which existing retrievers often struggle to capture. To address this challenge, we present DIVER, a retrieval pipeline designed for reasoning-intensive information retrieval. It consists of four components. The document preprocessing stage enhances readability and preserves content by cleaning noisy texts and segmenting long documents. The query expansion stage leverages large language models to iteratively refine user queries with explicit reasoning and evidence from retrieved documents. The retrieval stage employs a model fine-tuned on synthetic data spanning medical and mathematical domains, along with hard negatives, enabling effective handling of reasoning-intensive queries. Finally, the reranking stage combines pointwise and listwise strategies to produce both fine-grained and globally consistent rankings. On the BRIGHT benchmark, DIVER achieves state-of-the-art nDCG@10 scores of 46.8 overall and 31.9 on original queries, consistently outperforming competitive reasoning-aware models. These results demonstrate the effectiveness of reasoning-aware retrieval strategies in complex real-world tasks.

信息检索推理增强大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。