arXiv:2511.15557cs.DBcs.AI2025-11被引 2

提出B+ANN,用磁盘存储海量向量,查询更快更省内存。

B+ANN: A Fast Billion-Scale Disk-based Nearest-Neighbor Index

  • 分块构建B+树索引,兼顾内存与磁盘存储
  • 相比HNSW,召回率更高,每秒查询数提升,缓存命中率提高19.23%
  • 支持相似与相异双重查询,适合大规模向量检索场景

专用向量数据库(VDB)已成为现代AI流程的核心。当前多数VDB采用基于图的近似最近邻(ANN)索引算法——HNSW,用于回答语义查询。然而HNSW存在内存设计、随机访问导致缓存效率低、细粒度计算限制加速范围,且仅支持相似性查询等问题。本文提出新型磁盘级ANN索引B+ANN:首先将输入数据按语义相似性分块,再构建变体B+树,在内存和磁盘上存储块,最终实现混合边与块级别的内存遍历。实验表明,所提B+ANN在质量(召回率)和性能(每秒查询数)上均优于HNSW,通过提升语义操作的空间与时间局部性,减少缓存未命中19.23%,内存消耗和磁盘构建时间比DiskANN降低24倍。此外,其支持非相似性查询,这是传统以相似性为导向的ANN索引所不具备的能力。

原文摘要 · Abstract (English)

Storing and processing of embedding vectors by specialized Vector databases (VDBs) has become the linchpin in building modern AI pipelines. Most current VDBs employ variants of a graph-based ap- proximate nearest-neighbor (ANN) index algorithm, HNSW, to an- swer semantic queries over stored vectors. Inspite of its wide-spread use, the HNSW algorithm suffers from several issues: in-memory design and implementation, random memory accesses leading to degradation in cache behavior, limited acceleration scope due to fine-grained pairwise computations, and support of only semantic similarity queries. In this paper, we present a novel disk-based ANN index, B+ANN, to address these issues: it first partitions input data into blocks containing semantically similar items, then builds an B+ tree variant to store blocks both in-memory and on disks, and finally, enables hybrid edge- and block-based in-memory traversals. As demonstrated by our experimantal evaluation, the proposed B+ANN disk-based index improves both quality (Recall value), and execution performance (Queries per second/QPS) over HNSW, by improving spatial and temporal locality for semantic operations, reducing cache misses (19.23% relative gain), and decreasing the memory consumption and disk-based build time by 24x over the DiskANN algorithm. Finally, it enables dissimilarity queries, which are not supported by similarity-oriented ANN indices.

向量检索磁盘索引近邻搜索B+树

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。