系统研究了图向量搜索在GPU上的加速方法与瓶颈。
GPU-Accelerated Algorithms for Graph Vector Search: Taxonomy, Empirical Study, and Research Directions
- 构建了GPU优化策略的详细分类体系。
- 发现距离计算和主机-设备数据传输是主要性能瓶颈。
- 适合需要高效向量搜索的系统设计者参考。
近似最近邻搜索(ANNS)支撑着众多大规模数据挖掘和机器学习应用,随着数据集规模增长,高效检索越来越依赖于GPU加速。尽管基于图的方法代表了近似最近邻搜索的最新水平,但对其在现代GPU架构上的优化以及实际场景中端到端有效性的系统性理解仍显不足。本文对基于图的向量搜索算法在GPU上的加速进行了全面综述与实验研究,建立了详细的GPU优化策略分类,并明确了算法任务与GPU硬件执行单元之间的映射关系。通过对六种领先算法在八个大规模基准数据集上的全面评估,我们分析了图索引构建与查询搜索的性能表现。研究发现,距离计算仍是主要计算瓶颈,而主机CPU与GPU之间的数据传输成为大规模场景下影响实际延迟的主要因素。此外,我们还揭示了不同系统设计在可扩展性与内存使用方面的关键权衡。研究成果为设计可扩展、鲁棒的GPU加速近似最近邻搜索系统提供了清晰指导,并为知识发现与数据挖掘领域提供了综合性基准。
原文摘要 · Abstract (English)
Approximate Nearest Neighbor Search (ANNS) underpins many large-scale data mining and machine learning applications, with efficient retrieval increasingly hinging on GPU acceleration as dataset sizes grow. Although graph-based approaches represent the state of the art in approximate nearest neighbor search, there is a lack of systematic understanding regarding their optimization for modern GPU architectures and their end-to-end effectiveness in practical scenarios. In this work, we present a comprehensive survey and experimental study of GPU-accelerated graph-based vector search algorithms. We establish a detailed taxonomy of GPU optimization strategies and clarify the mapping between algorithmic tasks and hardware execution units within GPUs. Through a thorough evaluation of six leading algorithms on eight large-scale benchmark datasets, we assess both graph index construction and query search performance. Our analysis reveals that distance computation remains the primary computational bottleneck, while data transfer between the host CPU and GPU emerges as the dominant factor influencing real-world latency at large scale. We also highlight key trade-offs in scalability and memory usage across different system designs. Our findings offer clear guidelines for designing scalable and robust GPU-powered approximate nearest neighbor search systems, and provide a comprehensive benchmark for the knowledge discovery and data mining community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。