arXiv:2409.16576cs.IRcs.DB2024-09被引 7

用单块入门级显卡实现百亿向量高效近邻搜索,性能成本双提升。

FusionANNS: An Efficient CPU/GPU Cooperative Processing Architecture for Billion-scale Approximate Nearest Neighbor Search

  • CPU与GPU协同过滤重排,减少跨设备数据交换
  • 多层索引+启发式重排+冗余去重,降低I/O开销90%以上
  • 适合资源受限但需高吞吐的百亿级向量检索场景

近似最近邻搜索(ANNS)已成为数据库与AI基础设施的关键组件。日益增长的向量数据集对ANNS服务在性能、成本和准确性方面带来巨大挑战,现有系统难以兼顾三者。本文提出FusionANNS,一种基于固态硬盘(SSD)和单块入门级GPU的高吞吐、低延迟、低成本且高精度的百亿级向量ANNS系统。核心思想是通过CPU/GPU协同过滤与重排机制,显著减少跨CPU、GPU与SSD间的I/O操作,突破I/O性能瓶颈。具体设计包括:(1) 多层级索引避免CPU与GPU间数据交换;(2) 启发式重排消除不必要的I/O与计算;(3) 冗余感知的I/O去重进一步提升效率。实验表明,相比最先进的基于SSD的SPANN系统,FusionANNS查询每秒处理能力(QPS)提升9.4–13.1倍,成本效率提升5.7–8.8倍;相比基于GPU加速的内存型RUMMY系统,其QPS提升2–4.9倍,成本效率提升2.3–6.8倍,同时保持低延迟与高准确率。

原文摘要 · Abstract (English)

Approximate nearest neighbor search (ANNS) has emerged as a crucial component of database and AI infrastructure. Ever-increasing vector datasets pose significant challenges in terms of performance, cost, and accuracy for ANNS services. None of modern ANNS systems can address these issues simultaneously. We present FusionANNS, a high-throughput, low-latency, cost-efficient, and high-accuracy ANNS system for billion-scale datasets using SSDs and only one entry-level GPU. The key idea of FusionANNS lies in CPU/GPU collaborative filtering and re-ranking mechanisms, which significantly reduce I/O operations across CPUs, GPU, and SSDs to break through the I/O performance bottleneck. Specifically, we propose three novel designs: (1) multi-tiered indexing to avoid data swapping between CPUs and GPU, (2) heuristic re-ranking to eliminate unnecessary I/Os and computations while guaranteeing high accuracy, and (3) redundant-aware I/O deduplication to further improve I/O efficiency. We implement FusionANNS and compare it with the state-of-the-art SSD-based ANNS system -- SPANN and GPU-accelerated in-memory ANNS system -- RUMMY. Experimental results show that FusionANNS achieves 1) 9.4-13.1X higher query per second (QPS) and 5.7-8.8X higher cost efficiency compared with SPANN; 2) and 2-4.9X higher QPS and 2.3-6.8X higher cost efficiency compared with RUMMY, while guaranteeing low latency and high accuracy.

向量搜索低延迟成本优化协同计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。