arXiv:2607.23561cs.IR2026-07

把相关性建模为先验与似然的组合,提升检索效率与效果。

Towards a Relevance Posterior in Neural Information Access

  • 将相关性拆解为查询无关的文档先验和查询相关的似然,分阶段计算。
  • 在TREC DL数据集上,融合先验使首阶段检索提升0.046 nDCG@10,重排序提升0.054。
  • 适合关注离线计算优化与大模型检索系统设计的研究者。

现代信息检索系统通常在查询时计算条件相关性得分,这种单一体系日益受限于神经排序模型的高算力需求和多阶段流程的复杂性。本文提出将信息访问理解为近似后验推断,通过查询无关的文档先验与查询依赖的似然逐步融合来优化相关性。我们扩展经典概率检索框架以适配学习型系统,证明显式分解能将部分计算移至离线阶段,并分离文档级与交互级信念。实验证明,引入学习到的先验可显著提升检索效果:在TREC DL-2019上首阶段检索提升0.046 nDCG@10,TREC DL-2020上达0.029;对下游重排序器(如RankZephyr)最大提升达0.054 nDCG@10。该范式为构建更高效、可解释的检索系统提供了新方向。

原文摘要 · Abstract (English)

Modern information retrieval systems typically operationalise relevance as a query-conditional score computed at inference time. This design choice has become dominant such that alternative decompositions of relevance are rarely discussed, despite the long history of document and query priors in probabilistic retrieval and large-scale search. As neural ranking models grow more computationally expensive and retrieval pipelines expand to include multi-stage ranking, recommendation, and retrieval-augmented generation, this monolithic view of query-time scoring becomes increasingly limiting. We argue that modern information access systems are more naturally understood as performing approximate posterior inference, in which relevance is refined through a staged combination of query-dependent likelihoods and query-independent priors. We extend classical probabilistic retrieval formalisms to contemporary learned systems and show how explicit likelihood-prior decomposition exposes new opportunities to shift computation offline while disentangling document-level and interaction-level beliefs. We present empirical evidence that incorporating query-independent document utility can complement existing rankers and improve effectiveness with minimal query-time computation (solely score fusion). Concretely, a learned prior improves first-stage retrieval through rank fusion (up to 0.046 nDCG@10 on TREC DL-2019 and 0.029 nDCG@10 on TREC DL-2020) and also improves downstream re-ranking, with the largest gains observed for the LLM re-ranker RankZephyr (up to 0.054 nDCG@10 on TREC DL-2020). Finally, we discuss how this decomposition connects to broader information access and outline research directions for designing retrieval systems that explicitly allocate modelling capacity between offline priors and online interaction.

信息检索后验建模先验利用检索优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。