arXiv:2601.07183cs.DBcs.IR2026-01被引 2

优化向量数据库中冗余分配与列表布局,提升近似最近邻搜索效率

RAIRS: Optimizing Redundant Assignment and List Layout for IVF-Based ANN Search

  • 提出针对欧氏空间的AIR度量,综合距离与方向优化列表选择
  • 设计共享单元布局SEIL,减少重复距离计算,查询吞吐最高提升33%
  • 适用于大规模向量检索场景,尤其适合高精度需求的工业级系统

IVF是向量数据库中最常用的近似最近邻搜索(ANNS)方法之一。冗余分配策略通过将数据向量分配至多个IVF列表,降低搜索时遗漏真实邻居的概率。然而,传统基于向量与列表中心距离选择第二列表的方法效果不佳。现有研究仅关注内积距离,缺乏对最主流的欧氏空间的优化。此外,同一向量可能被多个列表访问,导致重复距离计算,降低查询吞吐。本文提出RAIRS,解决上述两个问题:针对列表选择,提出适用于欧氏空间的优化指标AIR,不仅考虑距离还纳入方向信息,以支持与查询更接近但远离首选列表中心的数据向量;针对冗余计算,提出SEIL优化列表布局,利用共享单元减少重复距离计算。在代表性真实数据集上的实验表明,RAIRS优于现有冗余分配方案,相比表现最佳的IVF-PQ Fast Scan with refinement,查询性能最高提升1.33倍。

原文摘要 · Abstract (English)

IVF is one of the most widely used ANNS (Approximate Nearest Neighbors Search) methods in vector databases. The idea of redundant assignment is to assign a data vector to more than one IVF lists for reducing the chance of missing true neighbors in IVF search. However, the naive strategy, which selects the second IVF list based on the distance between a data vector and the list centroids, performs poorly. Previous work focuses only on the inner product distance, while there is no optimized list selection study for the most popular Euclidean space. Moreover, the IVF search may access the same vector in more than one lists, resulting in redundant distance computation and decreasing query throughput. In this paper, we present RAIRS to address the above two challenges. For the challenge of the list selection, we propose an optimized AIR metric for the Euclidean space. AIR takes not only distances but also directions into consideration in order to support queries that are closer to the data vector but father away from the first chosen list's centroid. For the challenge of redundant distance computation, we propose SEIL, an optimized list layout that exploits shared cells to reduce repeated distance computations for IVF search. Our experimental results using representative real-world data sets show that RAIRS out-performs existing redundant assignment solutions and achieves up to 1.33x improvement over the best-performing IVF method, IVF-PQ Fast Scan with refinement.

近似搜索向量数据库冗余分配高效检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。