针对鲲鹏920架构优化的近似最近邻搜索算法,性能超越主流x86方案。
KScaNN: Scalable Approximate Nearest Neighbor Search on Kunpeng
- 针对鲲鹏920设计混合聚类搜索与改进的乘积量化残差计算方法。
- 引入机器学习驱动的自适应搜索模块,实现查询级参数动态调优。
- 定制化ARM SIMD内核提升关键距离计算效率,实测提速1.63倍。
近似最近邻搜索(ANNS)是信息检索、推荐系统和机器学习的核心算法。尽管传统上以x86架构为主,但工业界对ARM服务器的采用日益增长,亟需针对ARM架构优化的ANNS方案。直接将现有x86 ANNS算法移植到ARM平台会导致显著性能下降,无法发挥硬件优势。为此,我们提出KScaNN,一种专为鲲鹏920 ARM架构协同设计的新型ANNS算法。其核心贡献包括:1)创新的算法技术,如混合聚类内搜索策略和改进的乘积量化残差计算方法,从高层优化搜索过程;2)基于机器学习的自适应搜索模块,实现每查询的参数动态调优,消除静态配置的低效问题;3)针对ARM架构高度优化的SIMD内核,充分释放关键距离计算任务的硬件性能。实验表明,KScaNN不仅弥合了性能差距,更达到新标杆,较最快的x86方案最高提升1.63倍。该工作为现代ARM架构上的向量搜索性能领先提供了明确蓝图。
原文摘要 · Abstract (English)
Approximate Nearest Neighbor Search (ANNS) is a cornerstone algorithm for information retrieval, recommendation systems, and machine learning applications. While x86-based architectures have historically dominated this domain, the increasing adoption of ARM-based servers in industry presents a critical need for ANNS solutions optimized on ARM architectures. A naive port of existing x86 ANNS algorithms to ARM platforms results in a substantial performance deficit, failing to leverage the unique capabilities of the underlying hardware. To address this challenge, we introduce KScaNN, a novel ANNS algorithm co-designed for the Kunpeng 920 ARM architecture. KScaNN embodies a holistic approach that synergizes sophisticated, data aware algorithmic refinements with carefully-designed hardware specific optimizations. Its core contributions include: 1) novel algorithmic techniques, including a hybrid intra-cluster search strategy and an improved PQ residual calculation method, which optimize the search process at a higher level; 2) an ML-driven adaptive search module that provides adaptive, per-query tuning of search parameters, eliminating the inefficiencies of static configurations; and 3) highly-optimized SIMD kernels for ARM that maximize hardware utilization for the critical distance computation workloads. The experimental results demonstrate that KScaNN not only closes the performance gap but establishes a new standard, achieving up to a 1.63x speedup over the fastest x86-based solution. This work provides a definitive blueprint for achieving leadership-class performance for vector search on modern ARM architectures and underscores
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。