优化稀疏检索的前向索引压缩,提升存储效率且不降搜索性能。
Forward Index Compression for Learned Sparse Retrieval
- 提出针对内积计算优化的DotVByte压缩算法
- 在MsMarco上实现显著空间节省,保持检索效率
- 适合关注检索系统存储优化的研究者与工程师
基于学习的稀疏表示已发展为一种高效的文本检索方法。得益于近似最近邻搜索技术的进步,如基于倒排索引的Seismic和基于图的Hnsw,稀疏表示检索在实践中变得可行。本文聚焦于各类算法共有的关键数据结构——前向索引,其占整体索引大小的较大比例。研究旨在通过压缩技术减小前向索引的存储开销,同时不损害检索质量或内积计算延迟。实验对比多种整数压缩方法后发现,StreamVByte在内存占用、检索准确率和延迟间表现最佳。进一步提出专为内积计算优化的DotVByte算法。在MsMarco数据集上的实验表明,该改进带来显著空间节省,同时维持高效检索性能。
原文摘要 · Abstract (English)
Text retrieval using learned sparse representations of queries and documents has, over the years, evolved into a highly effective approach to search. It is thanks to recent advances in approximate nearest neighbor search-with the emergence of highly efficient algorithms such as the inverted index-based Seismic and the graph-based Hnsw-that retrieval with sparse representations became viable in practice. In this work, we scrutinize the efficiency of sparse retrieval algorithms and focus particularly on the size of a data structure that is common to all algorithmic flavors and that constitutes a substantial fraction of the overall index size: the forward index. In particular, we seek compression techniques to reduce the storage footprint of the forward index without compromising search quality or inner product computation latency. In our examination with various integer compression techniques, we report that StreamVByte achieves the best trade-off between memory footprint, retrieval accuracy, and latency. We then improve StreamVByte by introducing DotVByte, a new algorithm tailored to inner product computation. Experiments on MsMarco show that our improvements lead to significant space savings while maintaining retrieval efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。