arXiv:2608.15438cs.DBcs.IR2026-08

用神经路由让百亿向量搜索又快又准,一小时搞定索引构建。

NeuRoute: Logit-Guided Neural Routing for Billion-Scale Vector Search with Sub-Hour Index Construction

论文配图:NeuRoute: Logit-Guided Neural Routing for Billion-Scale Vector Search with Sub-Hour Index Construction
图 1 · 摘自论文原文
  • 通过二进制编码引导路由,用轻量神经网络生成均衡地址。
  • 在BigANN-1B上达90.3%召回率,2414 QPS,比基线快1.7倍。
  • 适合需要快速构建百亿级索引的工业应用,尤其看重部署效率。

在百亿规模下构建近似最近邻(ANN)索引常受昂贵的全局聚类或图结构构建所制约,导致索引构建时间成为首要系统问题。我们提出NeuRoute,一种基于学习哈希的索引方法,将短二进制码转化为大规模向量搜索的有效路由机制。NeuRoute训练一个轻量级神经网络编码器,采用选择性保序目标生成均衡的二进制地址。构建阶段,按编码将向量分桶,并在编码器低维空间内进行桶内聚类以形成质心。查询时,利用编码器输出的logits作为不确定度信号:通过偏差阈值评分优先扰动不确定位,实现自适应多桶探测;按距离评分桶内质心,生成紧凑候选簇集;并采用堆质量驱动的早期停止机制,在精确细化前剪枝低价值簇。在百亿级基准测试中,NeuRoute实现了出色的精度-吞吐权衡,索引构建迅速:在BigANN-1B上达到90.3% Recall@10,2,414 QPS,较OPQ+IVF-PQ(refine)快1.7倍,且在BigANN-1B与Deep1B-1B上均能在一小时内完成端到端训练与构建。结果表明,基于logit的神经路由可使哈希方法在百亿规模下具备竞争力。源码与实验材料见https://github.com/XingqiaoWang/NeuRoute。

原文摘要 · Abstract (English)

Building approximate nearest neighbor (ANN) indexes at billion scale is often dominated by expensive global clustering or graph construction, making time-to-index a first-order systems concern. We present NeuRoute, a learned hashing index that turns short binary codes into an effective routing primitive for large-scale vector search. NeuRoute trains a lightweight neural network encoder with a selective similarity-preserving objective to produce well-balanced binary addresses. During construction, NeuRoute organizes vectors into buckets by their codes and performs bucket-local clustering in the encoder's low-dimensional space to form centroids. At query time, NeuRoute exploits the encoder logits as an uncertainty signal: it uses deviation-to-threshold scores to prioritize uncertain-bit perturbations for query-adaptive multi-bucket probing, scores bucket-local centroids by their distances to the query to form a compact candidate cluster set, and applies centroid-stage gating with heap-quality-driven early stopping to prune low-value clusters before exact refinement. On billion-scale benchmarks, NeuRoute achieves strong accuracy-throughput trade-offs with fast index construction: on BigANN-1B it reaches $90.3\%$ Recall@10 at 2,414 QPS and is $1.7\times$ faster than OPQ+IVF-PQ (refine) at comparable accuracy, while completing end-to-end training+construction in under an hour on both BigANN-1B and Deep1B-1B. These results show that logit-guided neural routing can make hashing competitive as a lightweight ANN indexing framework at billion scale. Source code and artifacts are available at https://github.com/XingqiaoWang/NeuRoute.

向量搜索神经路由百亿索引哈希索引

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。