提出无需依赖相关性假设的查询重写框架,提升检索效果
Generalized Pseudo-Relevance Feedback
- 基于强化学习设计实用导向训练流程,减少对相关文档的依赖
- 在多个基准上超越强基线,表现稳定且泛化能力强
- 适合需要模型无关、抗噪声重写的检索系统
查询重写是信息检索中的基础技术,通常利用检索结果作为相关性反馈来优化查询,缓解用户查询与文档之间的词汇不匹配问题。传统伪相关反馈(PRF)及其向量扩展(VPRF)依赖两个核心假设:相关性假设(排名靠前的文档是相关的)和模型假设(重写方法需针对特定模型架构设计)。尽管基于大语言模型的生成式相关反馈(GRF)实现了模型无关的查询重写,但仍面临严重幻觉或依赖相关性假设的问题。为此,本文提出一种假设松弛框架——广义伪相关反馈(GPRF),基于检索到的文档进行自然语言层面的模型无关重写,既消除模型假设,又降低对相关性假设的依赖。我们设计了一种以效用为导向的强化学习训练流程,增强对噪声反馈的鲁棒性。在多个基准和检索器上的大量实验表明,GPRF持续优于强基线,展现出良好的有效性和可泛化性。
原文摘要 · Abstract (English)
Query rewriting is a fundamental technique in information retrieval (IR). It typically employs the retrieval result as relevance feedback to refine the query and thereby addresses the vocabulary mismatch between user queries and relevant documents. Traditional pseudo-relevance feedback (PRF) and its vector-based extension (VPRF) improve retrieval performance by leveraging top-retrieved documents as relevance feedback. However, they are constructed based on two major hypotheses: the relevance assumption (top documents are relevant) and the model assumption (rewriting methods need to be designed specifically for particular model architectures). While recent large language models (LLMs)-based generative relevance feedback (GRF) enables model-free query reformulation, it either suffers from severe LLM hallucination or, again, relies on the relevance assumption to guarantee the effectiveness of rewriting quality. To overcome these limitations, we introduce an assumption-relaxed framework: \textit{Generalized Pseudo Relevance Feedback} (GPRF), which performs model-free, natural language rewriting based on retrieved documents, not only eliminating the model assumption but also reducing dependence on the relevance assumption. Specifically, we design a utility-oriented training pipeline with reinforcement learning to ensure robustness against noisy feedback. Extensive experiments across multiple benchmarks and retrievers demonstrate that GPRF consistently outperforms strong baselines, establishing it as an effective and generalizable framework for query rewriting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。