arXiv:2511.16921cs.IR2025-11被引 1

提出新型图索引δ-EMG,实现可证明的近似搜索精度保证。

δ-EMG: A Monotonic Graph Index for Approximate Nearest Neighbor Search

  • 基于δ-单调几何约束构建图结构,确保贪婪搜索收敛到(1/δ)近似邻点
  • 在SIFT1M数据集上召回率0.99时达19,000 QPS,性能提升超40%
  • 支持动态控制精度,适合对结果可靠性有严格要求的系统

高维空间中的近似最近邻(ANN)搜索是现代检索与推荐系统的核心。现有方法普遍采用ε-召回率约束,仅保证真阳性结果的召回率,却无法控制错误结果的偏差。为此,本文提出误差有界(Error-Bounded)ANN方法,确保返回结果为真实值的(1/δ)近似。我们设计了首个可证明对任意查询均有效的δ-EMG(误差有界单调图),通过δ-单调几何约束,使任意贪婪搜索无需回溯即可收敛至(1/δ)近似邻点。在此基础上,提出自适应控制精度的误差有界top-k ANN算法。为提升可扩展性,引入δ-EMQG(误差有界单调量化图),具备近线性构造复杂度和局部化、度平衡特性,并集成向量量化加速距离计算,同时保持理论保证。在ANN-Benchmarks数据集上的实验表明:当召回率要求为0.99时,该方法在SIFT1M数据集上达到19,000 QPS,性能优于其他方法40%以上。

原文摘要 · Abstract (English)

Approximate nearest neighbor (ANN) search in high-dimensional spaces is a foundational component of many modern retrieval and recommendation systems. Currently, almost all algorithms follow an $ε$-Recall-Bounded principle when comparing performance: they require the ANN search results to achieve a recall of more than $1-ε$ and then compare query-per-second (QPS) performance. However, this approach only accounts for the recall of true positive results and does not provide guarantees on the deviation of incorrect results. To address this limitation, we focus on an Error-Bounded ANN method, which ensures that the returned results are a $(1/δ)$-approximation of the true values. Our approach adopts a graph-based framework. To enable Error-Bounded ANN search, we propose a $δ$-EMG (Error-bounded Monotonic Graph), which, for the first time, provides a provable approximation for arbitrary queries. By enforcing a $δ$-monotonic geometric constraint during graph construction, $δ$-EMG ensures that any greedy search converges to a $(1/δ)$-approximate neighbor without backtracking. Building on this foundation, we design an error-bounded top-$k$ ANN search algorithm that adaptively controls approximation accuracy during query time. To make the framework practical at scale, we introduce $δ$-EMQG (Error-bounded Monotonic Quantized Graph), a localized and degree-balanced variant with near-linear construction complexity. We further integrate vector quantization to accelerate distance computation while preserving theoretical guarantees. Extensive experiments on the ANN-Benchmarks dataset demonstrate the effectiveness of our approach. Under a recall requirement of 0.99, our algorithm achieves 19,000 QPS on the SIFT1M dataset, outperforming other methods by more than 40\%.

近邻搜索图索引误差保证高效检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。