优化大模型深研中的文本排序,提升搜索结果相关性。
Revisiting Text Ranking in Deep Research

- 用自然语言重写代理查询,缓解查询与训练数据不匹配问题。
- 段落级检索更高效,尤其在上下文受限时表现更优。
- 重排序显著提升效果,适合需要精准检索的研究场景。
深度研究旨在解决需广泛网络探索的复杂查询。现有方法多依赖黑箱搜索接口,使文本排序机制不透明。本文在固定语料库的BrowseComp-Plus数据集上,评估2个开源代理、5种检索器和3种重排序器,从检索单元(文档vs.段落)、流水线配置(不同检索器、重排序器及深度)和查询特征(代理查询与训练查询的差异)三方面分析有效性。结果表明:代理查询多为网页搜索风格(如带引号的精确匹配),偏好词法、稀疏表示和多向量检索器;段落级单位在上下文窗口有限时更高效,避免文档长度归一化难题;重排序效果显著。为此提出查询转问题(Q2Q)方法,将代理查询转化为自然语言问题,大幅降低查询偏差。
原文摘要 · Abstract (English)
Deep research has emerged as an important task that aims to address hard queries that need extensive open-web exploration. To tackle it, most prior work equips large language model (LLM)-based agents with opaque web search APIs, enabling agents to iteratively issue search queries, retrieve external evidence, and reason over it. Despite search's essential role in deep research, black-box web search APIs leave the behaviour of established text ranking methods in deep research largely unclear. To fill this gap, we reproduce key findings and best practices for text ranking methods in deep research. We examine their effectiveness from three perspectives: (i) retrieval units (documents vs. passages), (ii) pipeline configurations (different retrievers, re-rankers, and re-ranking depths), and (iii) query characteristics (the mismatch between agent-issued queries and the training queries of text rankers). We perform experiments on BrowseComp-Plus, a deep research dataset with a fixed corpus, evaluating 2 open-source agents, 5 retrievers, and 3 re-rankers. We find that agent-issued queries typically follow web-search-style syntax (e.g., quoted exact matches), favouring lexical, learned sparse, and multi-vector retrievers; passage-level units are more efficient under limited context windows, and avoid the difficulties of document length normalisation in lexical retrieval; re-ranking is highly effective. We further propose a query-to-question (Q2Q) method that translates agent-issued queries into natural language questions, significantly reducing the query mismatch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。