arXiv:2505.15636cs.IRcs.DB2025-05NeurIPS被引 3

提出新搜索终止条件,让图搜索更准更稳。

Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search

  • 用距离替代宽度决定搜索何时停止,更合理。
  • 在多种图结构上验证,召回率均优于传统方法。
  • 适合想提升检索精度的工程师和研究者使用。

最近邻搜索在机器学习、信息检索和数据库中至关重要。针对高维数据集,基于图的方法如HNSW、DiskANN和NSG因其良好的准确性和效率而广受欢迎。这些方法在数据集上构建有向图,并在图上执行束搜索以找到与查询点接近的节点。尽管已有大量工作聚焦于实践优化和理论分析,但仍存在诸多未解问题。本文提出一种新的基于距离的束搜索终止条件,取代常用的基于束宽的条件。我们证明,只要搜索图具备可导航性,所提出的自适应束搜索(Adaptive Beam Search)方法能够保证近似求解最近邻问题,建立了可导航性与图搜索性能之间的联系。我们在真实使用的可导航图和近似可导航图(如HNSW和Vamana图)上进行了广泛实验,结果表明,自适应束搜索在多种召回率、数据集、图构建方式和目标近邻数下均优于标准束搜索,为提升主流方法性能提供了一种简单且实用的方案。

原文摘要 · Abstract (English)

Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and efficiency. These methods construct a directed graph over the dataset and perform beam search on the graph to find nodes close to a given query. While significant work has focused on practical refinements and theoretical understanding of graph-based methods, many questions remain. We propose a new distance-based termination condition for beam search to replace the commonly used condition based on beam width. We prove that, as long as the search graph is navigable, our resulting Adaptive Beam Search method is guaranteed to approximately solve the nearest-neighbor problem, establishing a connection between navigability and the performance of graph-based search. We also provide extensive experiments on our new termination condition for both navigable graphs and approximately navigable graphs used in practice, such as HNSW and Vamana graphs. We find that Adaptive Beam Search outperforms standard beam search over a range of recall values, data sets, graph constructions, and target number of nearest neighbors. It thus provides a simple and practical way to improve the performance of popular methods.

最近邻搜索图算法束搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。