arXiv:2602.23999cs.DBcs.DS2026-02被引 7

GPU加速的近邻搜索新方法,速度快、精度高、内存小。

GPU-Native Approximate Nearest Neighbor Search with IVF-RaBitQ: Fast Index Build and Search

  • 将集群法与新型量化技术结合,实现GPU原生索引构建
  • 在0.95召回率下,查询速度比当前最佳方案快3倍
  • 索引构建速度比同类方法快14.7倍,适合大规模推荐系统

基于GPU的近似最近邻搜索(ANNS)在处理海量高维向量的现代检索与推荐任务中日益流行。图结构索引虽召回率高、吞吐量大,但构建和存储开销巨大;而聚类方法构建高效、可扩展,但通常需大量探测才能达高召回,加剧内存带宽和计算压力。为此,我们提出IVF-RaBitQ(GPU),一种集成聚类方法IVF与RaBitQ量化技术的GPU原生ANNS方案,兼顾快速索引构建、高吞吐搜索、高召回率和低存储开销。具体而言,构建阶段开发了可扩展的GPU原生RaBitQ量化方法,支持大规模低比特编码;搜索阶段设计了针对RaBitQ码的GPU原生距离计算与融合搜索核,实现高吞吐与高召回。在cuVS Bench多个数据集上的实验表明,集成至NVIDIA cuVS库的IVF-RaBitQ在召回率约0.95时,查询每秒请求数(QPS)较当前最优图方法CAGRA提升3.0倍,平均索引构建速度提升14.7倍。相比聚类方法IVF-PQ,IVF-RaBitQ平均吞吐提升超4.5倍,且无需访问原始向量进行重排序。

原文摘要 · Abstract (English)

Approximate nearest neighbor search (ANNS) on GPUs is gaining increasing popularity for modern retrieval and recommendation workloads that operate over massive high-dimensional vectors. Graph-based indexes deliver high recall and throughput but incur heavy build-time and storage costs. In contrast, cluster-based methods build and scale efficiently yet often need many probes for high recall, straining memory bandwidth and compute. Aiming to simultaneously achieve fast index build, high-throughput search, high recall, and low storage requirement for GPUs, we present IVF-RaBitQ (GPU), a GPU-native ANNS solution that integrates the cluster-based method IVF with RaBitQ quantization into an efficient GPU index build/search pipeline. Specifically, for index build, we develop a scalable GPU-native RaBitQ quantization method that enables fast and accurate low-bit encoding at scale. For search, we develop GPU-native distance computation schemes for RaBitQ codes and a fused search kernel to achieve high throughput with high recall. With IVF-RaBitQ implemented and integrated into the NVIDIA cuVS Library, experiments on cuVS Bench across multiple datasets show that IVF-RaBitQ offers a strong performance frontier in recall, throughput, index build time, and storage footprint. For Recall approximately equal 0.95, IVF-RaBitQ achieves 3.0x higher QPS than the state-of-the-art graph-based method CAGRA, while also constructing indices 14.7x faster on average. Compared to the cluster-based method IVF-PQ, IVF-RaBitQ delivers on average over 4.5x higher throughput while avoiding accessing the raw vectors for reranking.

近邻搜索GPU加速向量检索量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。