arXiv:2604.22661cs.IRcs.CL2026-04

用查询性能预测选最优变体,提升RAG效率与质量

Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelines

  • 用查询性能预测筛选最优查询变体,避免全量执行耗时
  • 预检索预测器常优于后检索方法,且延迟更低
  • 发现检索相关性与生成质量间存在实用差距

大型语言模型使查询重写在现代检索和检索增强生成(RAG)流程中变得普遍,可生成多个语义等价的查询变体。然而,对每个变体都执行完整流程成本高昂,因此需选择性执行:能否在付出下游检索与生成代价前,就识别出最佳变体?本文研究查询性能预测(QPP)在即兴检索与端到端RAG中用于变体选择的能力。不同于传统QPP(跨主题评估查询难度),本文聚焦同主题内区分——从同一信息需求的多个重写变体中选出最优者。在TREC-RAG数据集上,使用稀疏与稠密检索器进行大规模实验,评估预检索与后检索预测器在相关性与决策型指标下的表现。结果揭示检索目标与生成目标之间存在系统性偏离:最大化nDCG等排名指标的变体往往无法生成最优答案,暴露了‘实用性差距’。尽管如此,QPP仍能可靠识别出比原始查询提升端到端质量的变体。值得注意的是,轻量级预检索预测器经常表现不逊于甚至优于更昂贵的后检索方法,为鲁棒RAG提供了低延迟解决方案。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have made query reformulation ubiquitous in modern retrieval and Retrieval-Augmented Generation (RAG) pipelines, enabling the generation of multiple semantically equivalent query variants. However, executing the full pipeline for every reformulation is computationally expensive, motivating selective execution: can we identify the best query variant before incurring downstream retrieval and generation costs? We investigate Query Performance Prediction (QPP) as a mechanism for variant selection across ad-hoc retrieval and end-to-end RAG. Unlike traditional QPP, which estimates query difficulty across topics, we study intra-topic discrimination - selecting the optimal reformulation among competing variants of the same information need. Through large-scale experiments on TREC-RAG using both sparse and dense retrievers, we evaluate pre- and post-retrieval predictors under correlation- and decision-based metrics. Our results reveal a systematic divergence between retrieval and generation objectives: variants that maximize ranking metrics such as nDCG often fail to produce the best generated answers, exposing a "utility gap" between retrieval relevance and generation fidelity. Nevertheless, QPP can reliably identify variants that improve end-to-end quality over the original query. Notably, lightweight pre-retrieval predictors frequently match or outperform more expensive post-retrieval methods, offering a latency-efficient approach to robust RAG.

RAG查询重写性能预测效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。