arXiv:2605.19972cs.LGcs.AI2026-05

提出块球向量量化,提升嵌入压缩的精度与效率。

Block-Sphere Vector Quantization

论文配图:Block-Sphere Vector Quantization
图 1 · 摘自论文原文
  • 基于旋转嵌入的球面几何设计块级量化方法
  • 理论证明在均方误差和内积期望上优于现有方法
  • 适合长文本大模型推理中的高效嵌入存储

向量量化是可扩展机器学习系统的基础技术,支持内存高效存储、快速检索和压缩推理。近年来基于旋转的量化器如EDEN、RabitQ和TurboQuant带来了强保证和优异性能,但因使用不同失真准则、概率范式和实现假设,相互比较困难。本文首次提供统一理论对比,表明各方法优势依赖于具体指标:EDEN与TurboQuant在均方误差(MSE)下表现更优,EDEN也适用于期望内积失真,而RabitQ在高概率控制上更强。进一步地,本文提出块球量化(BlockQuant),一种基于随机旋转向量球面几何的新型分块旋转量化算法。不同于逐坐标量化,BlockQuant在球面上对块进行量化,更忠实保留旋转嵌入结构。理论上证明该设计在重建均方误差和期望内积失真上优于当前基线。在真实嵌入数据集和长上下文大模型推理任务上的实验显示,其实际性能提升与理论预测一致。

原文摘要 · Abstract (English)

Vector quantization is a fundamental primitive for scalable machine learning systems, enabling memory-efficient storage, fast retrieval, and compressed inference. Recent rotation-based quantizers such as EDEN, RabitQ, and TurboQuant have introduced strong guarantees and empirical performance, but the surrounding comparisons have been difficult to interpret because they rely on different distortion criteria, probability regimes, and implementation assumptions. As our first contribution, we provide a unified theoretical comparison of these methods and show that their relative advantages are criterion-dependent rather than absolute: EDEN and TurboQuant are favorable for MSE distortion, EDEN is also effective for expected inner-product distortion, and RabitQ provides strong high-probability control. This comparison further clarifies that EDEN provides particularly strong guarantees for expected distortion measures. As our second contribution, we introduce Block-Sphere Quantization (BlockQuant), a new rotation-based block quantization algorithm designed around the spherical geometry of randomly rotated vectors. Unlike coordinate-wise quantizers, BlockQuant quantizes blocks on the sphere, preserving the geometry of rotated embeddings more faithfully. We prove that this block-spherical design theoretically improves over the baselines considered in this paper for both reconstruction MSE and expected inner-product distortion. Our experiments on real embedding datasets and long-context LLM inference tasks show practical gains that are consistent with our theoretical improvements.

向量量化大模型压缩嵌入存储

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。