arXiv:2603.06159cs.DBcs.IR2026-03

一个模型搞定不同top-K的向量搜索,速度快且精度高。

Efficient Vector Search in the Wild: One Model for Multi-K Queries

  • 用轨迹特征训练基础模型,动态调整预测大K值
  • 在相同预处理成本下,平均延迟降低6%-33%
  • 适合实际场景中多K值混合查询的高效服务

学习型top-K搜索在保证高精度和高性能方面具有潜力。然而,针对特定K值训练的现有模型难以泛化到真实世界中的多K查询:在较大K值时准确率下降,在较小K值时性能损耗。为实现对不同K值的泛化,传统方法需数倍于现有水平的预处理时间,不适合实际服务。本文提出OMEGA,一种可泛化于多K的高效学习型top-K搜索方法,在保持高精度、高性能的同时,显著降低预处理开销。核心思想是:基于轨迹特征训练的K=1基础模型,通过动态优化过程可准确预测更大的K值,并在小K值时几乎无性能损失。为提升效率,进一步利用top-K搜索的统计特性减少模型调用次数。在多个公开及生产数据集上的评估表明,相同预处理预算下,OMEGA相较现有最优方法平均延迟降低6%-33%,且所有系统达到相同召回率目标;仅需16%-30%的预处理时间,即可实现基线最优平均延迟的1.01-1.28倍。

原文摘要 · Abstract (English)

Learned top-K search is a promising approach for serving vector queries with both high accuracy and performance. However, current models trained for a specific K value fail to generalize to real-world multi-K queries: they suffer from accuracy degradation (for larger Ks) and performance loss (for smaller Ks). Training the model to generalize on different Ks requires orders of magnitude more preprocessing time and is not suitable for serving vector queries in the wild. We present OMEGA, a K-generalizable learned top-K search method that simultaneously achieves high accuracy, high performance, and low preprocessing cost for multi-K vector queries. The key idea is that a base model properly trained on K=1 with our trajectory-based features can be used to accurately predict larger Ks with a dynamic refinement procedure and smaller Ks with minimal performance loss. To make our refinements efficient, we further leverage the statistical properties of top-K searches to reduce excessive model invocations. Extensive evaluations on multiple public and production datasets show that, under the same preprocessing budgets, OMEGA achieves 6-33% lower average latency compared to state-of-the-art learned search methods, while all systems achieve the same recall target. With only 16-30% of the preprocessing time, OMEGA attains 1.01-1.28x of the optimal average latency of these baselines.

向量搜索top-K高效推理多K支持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。