arXiv:2509.12086cs.DBcs.DS2025-09中稿 · SIGMOD被引 7

通过分段与码本调整,显著提升向量量化精度与编码速度。

SAQ: Pushing the Limits of Vector Quantization through Code Adjustment and Dimension Segmentation

  • 按维度重要性分段并动态分配比特,优化压缩效率。
  • 量化误差降低80%,编码速度比Extended RabitQ快80倍以上。
  • 适合需要高速高精度向量检索的推荐系统与大模型应用。

近似最近邻搜索(ANNS)在搜索引擎、推荐系统及大模型检索增强生成(RAG)中至关重要。向量量化(VQ)是降低存储开销和加速距离计算的关键技术,但现有方法仍难以平衡编码效率与量化精度。本文提出新型VQ方法SAQ:首先采用新的维度分段策略,将主成分分析(PCA)投影后的向量沿维度分段,优先为幅值较大的前导维度段分配更多比特;其次设计高效动态规划算法优化分段与比特分配,最小化量化误差。为加速编码,SAQ引入码本调整机制,先独立量化各维度,再通过类似坐标下降的方法逐步优化,避免穷举。大量实验表明,相比经典方法(如PQ、PCA)及最新技术(如LVQ、Extended RabitQ),SAQ在量化误差上最多减少80%,编码速度提升超80倍。

原文摘要 · Abstract (English)

Approximate Nearest Neighbor Search (ANNS) plays a critical role in applications such as search engines, recommender systems, and RAG for LLMs. Vector quantization (VQ), a crucial technique for ANNS, is commonly used to reduce space overhead and accelerate distance computations. However, despite significant research advances, state-of-the-art VQ methods still face challenges in balancing encoding efficiency and quantization accuracy. To address these limitations, we propose a novel VQ method called SAQ. To improve accuracy, SAQ employs a new dimension segmentation technique to strategically partition PCA-projected vectors into segments along their dimensions. By prioritizing leading dimension segments with larger magnitudes, SAQ allocates more bits to high-impact segments, optimizing the use of the available space quota. An efficient dynamic programming algorithm is developed to optimize dimension segmentation and bit allocation, ensuring minimal quantization error. To speed up vector encoding, SAQ devises a code adjustment technique to first quantize each dimension independently and then progressively refine quantized vectors using a coordinate-descent-like approach to avoid exhaustive enumeration. Extensive experiments demonstrate SAQ's superiority over classical methods (e.g., PQ, PCA) and recent state-of-the-art approaches (e.g., LVQ, Extended RabitQ). SAQ achieves up to 80% reduction in quantization error and accelerates encoding speed by over 80x compared to Extended RabitQ.

向量量化检索加速编码优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。