arXiv:2409.05882cs.IR2024-09被引 9

用稠密邻居网络提升关键词检索效果,几乎不增加计算开销。

LexBoost: Improving Lexical Document Retrieval with Nearest Neighbors

  • 索引时构建文档稠密邻居图,检索时融合文档自身与邻居的得分。
  • 在多个数据集上超越传统稠密重排,接近全量稠密检索性能。
  • 方法简单鲁棒,适合追求高效高精度检索的场景。

基于词面重叠的稀疏检索方法(如BM25)依赖倒排索引,具有高效率;而基于学习向量的稠密检索方法虽有效但较慢。为平衡效率与效果,常使用近似技术(如HNSW)加速稠密检索,但仍显著慢于稀疏方法。本文提出LexBoost:索引阶段利用稠密检索构建文档邻居网络(语料图),检索时同时考虑文档自身的词面相关性得分及其邻居的得分。该方法巧妙应用聚类假设,在几乎无额外计算开销(因图提前构建)的前提下,显著提升排序效果。实验表明,LexBoost对邻居数量、融合参数和数据构建方式均具鲁棒性。进一步在之上进行重排,性能优于传统稠密重排,达到接近高延迟全量稠密检索的效果。

原文摘要 · Abstract (English)

Sparse retrieval methods like BM25 are based on lexical overlap, focusing on the surface form of the terms that appear in the query and the document. The use of inverted indices in these methods leads to high retrieval efficiency. On the other hand, dense retrieval methods are based on learned dense vectors and, consequently, are effective but comparatively slow. Since sparse and dense methods approach problems differently and use complementary relevance signals, approximation methods were proposed to balance effectiveness and efficiency. For efficiency, approximation methods like HNSW are frequently used to approximate exhaustive dense retrieval. However, approximation techniques still exhibit considerably higher latency than sparse approaches. We propose LexBoost that first builds a network of dense neighbors (a corpus graph) using a dense retrieval approach while indexing. Then, during retrieval, we consider both a document's lexical relevance scores and its neighbors' scores to rank the documents. In LexBoost this remarkably simple application of the Cluster Hypothesis contributes to stronger ranking effectiveness while contributing little computational overhead (since the corpus graph is constructed offline). The method is robust across the number of neighbors considered, various fusion parameters for determining the scores, and different dataset construction methods. We also show that re-ranking on top of LexBoost outperforms traditional dense re-ranking and leads to results comparable with higher-latency exhaustive dense retrieval.

检索稠密向量图结构重排

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。