arXiv:2602.23342cs.DBcs.IR2026-02中稿 · SIGMOD 2026被引 4

针对高维向量搜索的计算瓶颈,提出高效索引布局与策略提升性能。

AlayaLaser: Efficient Index Layout and Search Strategy for Large-scale High-dimensional Vector Similarity Search

  • 基于屋顶模型分析发现高维下搜索成计算瓶颈,非传统认为的I/O瓶颈。
  • 利用SIMD指令优化数据布局,显著降低计算开销,提升搜索效率。
  • 适合大规模高维向量检索场景,尤其对资源受限系统有明显优势。

基于磁盘的图结构近似最近邻搜索(ANNS)对于大规模高维向量检索至关重要,但其性能常受高昂的I/O成本制约。然而,我们观察到随着向量维度升高(如数百或数千维),基于磁盘的图索引系统实际呈现计算瓶颈,而非传统认为的I/O瓶颈。这一发现揭示了重大优化机会:现有系统普遍聚焦于减少I/O,却忽视了计算开销,存在显著性能提升空间。本文提出AlayaLaser,一种高效的基于磁盘的图索引系统,用于大规模高维向量相似性搜索。首先,通过改进的屋顶模型对现有系统进行性能分析;随后设计新型磁盘数据布局,利用现代CPU的SIMD指令缓解计算瓶颈;进一步引入度优先节点缓存、基于聚类的入口点选择和早期分发策略等优化技术。在多种大规模高维向量数据集上的大量实验表明,AlayaLaser不仅超越现有基于磁盘的索引系统,甚至达到或超过内存索引系统的性能水平。

原文摘要 · Abstract (English)

On-disk graph-based approximate nearest neighbor search (ANNS) is essential for large-scale, high-dimensional vector retrieval, yet its performance is widely recognized to be limited by the prohibitive I/O costs. Interestingly, we observed that the performance of on-disk graph-based index systems is compute-bound, not I/O-bound, with the rising of the vector data dimensionality (e.g., hundreds or thousands). This insight uncovers a significant optimization opportunity: existing on-disk graph-based index systems universally target I/O reduction and largely overlook computational overhead, which leaves a substantial performance improvement space. In this work, we propose AlayaLaser, an efficient on-disk graph-based index system for large-scale high-dimensional vector similarity search. In particular, we first conduct performance analysis on existing on-disk graph-based index systems via the adapted roofline model, then we devise a novel on-disk data layout in AlayaLaser to effectively alleviate the compute-bound, which is revealed by the above roofline model analysis, by exploiting SIMD instructions on modern CPUs. We next design a suite of optimization techniques (e.g., degree-based node cache, cluster-based entry point selection, and early dispatch strategy) to further improve the performance of AlayaLaser. We last conduct extensive experimental studies on a wide range of large-scale high-dimensional vector datasets to verify the superiority of AlayaLaser. Specifically, AlayaLaser not only surpasses existing on-disk graph-based index systems but also matches or even exceeds the performance of in-memory index systems.

向量检索高维搜索索引优化SIMD加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。