用学习排序方法优化聚类代表点,提升近似最近邻搜索精度
Learning Cluster Representatives for Approximate Nearest Neighbor Search
- 将聚类路由视为排序问题,用学习排序方法优化代表点
- 线性函数学习代表点后,搜索准确率显著提升
- 适合需要高效高精度检索的推荐与图像搜索场景
现代信息检索中,开发更高效、更精确的近似最近邻搜索算法至关重要。聚类是主要方法之一,即把数据集划分为若干组,每组由一个代表性数据点表征。查询时先通过代表点识别最相关簇(路由步骤),再在这些簇内进行搜索,大幅缩小搜索空间。本文不仅系统阐述基于聚类的近似最近邻搜索,还提出并深入研究了一种新颖的前沿方法:基于一个自然观察——路由函数本质上是一个排序问题,因此可采用学习排序方法优化。将此直觉应用于最大内积搜索,证明使用简单线性函数学习聚类代表点能显著提升基于聚类的近似最近邻搜索的准确性。
原文摘要 · Abstract (English)
Developing increasingly efficient and accurate algorithms for approximate nearest neighbor search is a paramount goal in modern information retrieval. A primary approach to addressing this question is clustering, which involves partitioning the dataset into distinct groups, with each group characterized by a representative data point. By this method, retrieving the top-k data points for a query requires identifying the most relevant clusters based on their representatives -- a routing step -- and then conducting a nearest neighbor search within these clusters only, drastically reducing the search space. The objective of this thesis is not only to provide a comprehensive explanation of clustering-based approximate nearest neighbor search but also to introduce and delve into every aspect of our novel state-of-the-art method, which originated from a natural observation: The routing function solves a ranking problem, making the function amenable to learning-to-rank. The development of this intuition and applying it to maximum inner product search has led us to demonstrate that learning cluster representatives using a simple linear function significantly boosts the accuracy of clustering-based approximate nearest neighbor search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。