提升多向量检索效率,加速集群与查询处理。
Efficient Multivector Retrieval with Token-Aware Clustering and Hierarchical Indexing
- 基于令牌分布优化聚类中心分配,提升可扩展性。
- 在MS-MARCOv1和LoTTE上实现9.8倍检索加速。
- 适合需要高速检索的海量文档系统使用。
多向量检索模型通过细粒度的词元级表示达到顶尖效果,但部署时计算和内存开销巨大。现有方法依赖经典的k-means聚类算法,将相似向量分组以实现高效压缩与检索。然而,标准k-means在聚类数量和数据集规模增大时性能下降,且训练中偏好高频词元,忽视罕见但具有判别性的词元。本文提出TACHIOM系统,利用词元级结构显著加速聚类与检索过程。通过在中心点分配中考虑词元分布,TACHIOM可轻松扩展至数百万个中心点,仅用中心点即可实现高精度文档打分,避免昂贵的词元级计算。TACHIOM结合基于图的中心点索引与优化的乘积量化布局,实现高效最终评分。在MS-MARCOv1和LoTTE数据集上的实验表明,TACHIOM的聚类速度比k-means快达247倍,检索速度比现有最优系统快9.8倍,同时保持相当或更优的效果。
原文摘要 · Abstract (English)
Multivector retrieval models achieve state-of-the-art effectiveness through fine-grained token-level representations, but their deployment incurs substantial computational and memory costs. Current solutions, based on the well-known k-means clustering algorithm, group similar vectors together to enable both effective compression and efficient retrieval. However, standard k-means scales poorly with the number of clusters and dataset size, and favours frequent tokens during training while underrepresenting rare, discriminative ones. In this work, we introduce TACHIOM, a multivector retrieval system that exploits token-level structure to significantly accelerate both clustering and retrieval. By accounting for tokens' distribution during centroid allocation, TACHIOM easily scales to millions of centroids, enabling highly accurate document scoring using only centroids, avoiding expensive token-level computation. TACHIOM combines a graph-based index over centroids with an optimized Product Quantization layout for efficient final scoring. Experiments on MS-MARCOv1 and LoTTE show that TACHIOM achieves up to $247\times$ faster clustering than k-means and up to $9.8\times$ retrieval speedup over state-of-the-art systems while maintaining comparable or superior effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。