提出高效构造稀疏可导航图的新算法,速度提升至近二次方时间。
Efficiently Constructing Sparse Navigable Graphs
- 利用集合覆盖的关联性与流式算法加速图构建
- 实现O(log n)近似最优稀疏度,运行时间接近理论下界
- 适用于多种距离函数,适合大规模近邻搜索场景
近年来基于图的最近邻搜索方法广受欢迎,其核心是为带距离函数的数据集构造稀疏可导航搜索图。然而该过程计算成本高,实践中普遍依赖启发式方法。本文首次研究具有理论保证的快速算法:将问题转化为n个高度相关的最小集合覆盖实例,提出一种改进的贪心算法,可在$\tilde{O}(n^2)$时间内构造出稀疏度仅比最优值差$O(\log n)$的图。该复杂度在强指数时间假设下已为最优(通过单色最近点对归约证明)。此外,我们证明即便存在额外结构,获得优于$O(\log n)$近似解也是NP难的。最后,该方法还适用于构造$α$-快捷可达图和$τ$-单调图等实际重要图结构,分别达到$\tilde{O}(n^{2.5})$或更优的时间复杂度。
原文摘要 · Abstract (English)
Graph-based nearest neighbor search methods have seen a surge of popularity in recent years, offering state-of-the-art performance across a wide variety of applications. Central to these methods is the task of constructing a sparse navigable search graph for a given dataset endowed with a distance function. Unfortunately, doing so is computationally expensive, so heuristics are universally used in practice. In this work, we initiate the study of fast algorithms with provable guarantees for search graph construction. For a dataset with $n$ data points, the problem of constructing an optimally sparse navigable graph can be framed as $n$ separate but highly correlated minimum set cover instances. This yields a naive $O(n^3)$ time greedy algorithm that returns a navigable graph whose sparsity is at most $O(\log n)$ higher than optimal. We improve significantly on this baseline, taking advantage of correlation between the set cover instances to leverage techniques from streaming and sublinear-time set cover algorithms. By also introducing problem-specific pre-processing techniques, we obtain an $\tilde{O}(n^2)$ time algorithm for constructing an $O(\log n)$-approximate sparsest navigable graph under any distance function. The runtime of our method is optimal up to logarithmic factors under the Strong Exponential Time Hypothesis via a reduction from Monochromatic Closest Pair. Moreover, we prove that, as with general set cover, obtaining better than an $O(\log n)$-approximation is NP-hard, despite the significant additional structure present in the navigable graph problem. Finally, we show that our approach can also beat cubic time for the closely related and practically important problems of constructing $α$-shortcut reachable and $τ$-monotonic graphs, which are also used for nearest neighbor search. For such graphs, we obtain $\tilde{O}(n^{2.5})$ time or better algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。