用LLM评分指导高斯过程,高效挖掘相关段落。
Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval

- 以LLM打分作为稀疏信号,构建查询相关的高斯过程模型。
- 在相同LLM预算下,四项基准测试均优于现有重排序方法。
- 适合需要低成本高效检索的场景,尤其擅长发现语义差异大的相关段落。
尽管大语言模型(LLMs)在零样本相关性建模上表现卓越,但其高昂的计算成本要求将段落检索问题转化为预算受限的全局优化任务。现有方法被动依赖第一阶段密集检索器,存在两大缺陷:(1) 在语义差异显著的聚类中无法检索到相关段落;(2) 无法将相关性信号传播至整个语料库。为此,我们提出贝叶斯主动学习结合高斯过程并由LLM相关性评分引导的BAGEL框架,通过在嵌入空间中传播稀疏的LLM相关性信号来指导全局探索。BAGEL基于LLM相关性评分,为每个查询构建一个跨整个嵌入空间的多模态相关性分布的高斯过程(GP)模型,并迭代选择待评分段落,策略性地平衡高置信度区域的利用与不确定区域的探索。在四个基准数据集和两个LLM主干模型上的实验表明,BAGEL能有效探索并捕捉复杂的相关性分布,在所有四项测试中均以相同LLM预算超越现有重排序方法。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) exhibit exceptional zero-shot relevance modeling, their high computational cost necessitates framing passage retrieval as a budget-constrained global optimization problem. Existing approaches passively rely on first-stage dense retrievers, which leads to two limitations: (1) failing to retrieve relevant passages in semantically distinct clusters, and (2) failing to propagate relevance signals to the broader corpus. To address these limitations, we propose Bayesian Active Learning with Gaussian Processes guided by LLM relevance scoring (BAGEL), a novel framework that propagates sparse LLM relevance signals across the embedding space to guide global exploration. BAGEL models the multimodal relevance distribution across the entire embedding space with a query-specific Gaussian Process (GP) based on LLM relevance scores. Subsequently, it iteratively selects passages for scoring by strategically balancing the exploitation of high-confidence regions with the exploration of uncertain areas. Extensive experiments across four benchmark datasets and two LLM backbones demonstrate that BAGEL effectively explores and captures complex relevance distributions and outperforms LLM reranking methods under the same LLM budget on all four datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。