arXiv:2510.16393cs.IRcs.LG2025-10

融合词法与神经信号,提升文档检索效果且几乎不增加延迟

Blending Learning to Rank and Dense Representations for Efficient and Effective Cascades

  • 用决策树森林学习词法与神经特征的混合排序信号
  • 在MS-MARCO上实现nDCG@10最高提升11%,查询延迟仅增4.3%
  • 适合需要高效高精度检索的应用场景

本文研究了在即兴段落检索中同时利用词法与神经相关性信号。实验基于大规模训练数据集,其中包含来自MS-MARCO语料库的密集神经表示查询与段落,并补充了253个手工提取的词法特征。通过基于决策树森林的经典学习排序(LTR)模型,融合两类特征的相关性信号。为评估方案,采用级联架构:第一阶段使用密集神经检索器基于神经表示进行最近邻搜索;第二阶段由LTR模型对候选集重新排序以提升效果。在公开资源上使用最先进的密集检索器进行可复现实验,结果表明该方法显著提升端到端排序性能,同时对效率影响极小。具体而言,nDCG@10最高提升11%,平均查询延迟仅增加4.3%。这证实了无缝结合两类信号在提升检索有效性方面的优势。

原文摘要 · Abstract (English)

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are complemented and integrated with 253 hand-crafted lexical features extracted from the same corpus. Blending of the relevance signals from the two different groups of features is learned by a classical Learning-to-Rank (LTR) model based on a forest of decision trees. To evaluate our solution, we employ a pipelined architecture where a dense neural retriever serves as the first stage and performs a nearest-neighbor search over the neural representations of the documents. Our LTR model acts instead as the second stage that re-ranks the set of candidates retrieved by the first stage to enhance effectiveness. The results of reproducible experiments conducted with state-of-the-art dense retrievers on publicly available resources show that the proposed solution significantly enhances the end-to-end ranking performance while relatively minimally impacting efficiency. Specifically, we achieve a boost in nDCG@10 of up to 11% with an increase in average query latency of only 4.3%. This confirms the advantage of seamlessly combining two distinct families of signals that mutually contribute to retrieval effectiveness.

检索排序神经检索混合信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。