arXiv:2601.01291cs.DBcs.IR2026-01中稿 · SIGMOD 2026被引 4

提出Curator框架,高效处理低选择性过滤的向量搜索。

Curator: Efficient Vector Search with Low-Selectivity Filters

  • 基于共享聚类树构建标签专用索引,动态适应向量分布。
  • 在低选择性查询下,延迟降低最高达20.9倍,内存增加仅4.3%。
  • 支持增量更新与复杂谓词,适合实时向量检索系统。

基于嵌入的稠密检索已成为众多关键应用的核心,其中近似最近邻搜索(ANNS)常与日期、价格范围等标签过滤结合。图结构索引在无过滤场景下表现最优,但在低选择性过滤查询中,符合条件的向量稀疏导致图结构断裂。现有研究通过扩展图度数来解决此问题,但构造成本过高。为此,我们提出双索引架构,设计Curator:一种基于分块的索引,补充现有图索引以应对低选择性过滤的ANNS。Curator在共享聚类树内为不同标签构建专用索引,每个索引根据其合格向量分布自适应调整,确保高效搜索的同时共享结构以降低内存开销。系统还支持增量更新,并能通过即时构建临时索引处理任意复杂谓词。评估显示,将Curator与先进图索引结合,相比预过滤回退方案,低选择性查询延迟最高降低20.9倍,构建时间与内存开销仅增加5.5%和4.3%。

原文摘要 · Abstract (English)

Embedding-based dense retrieval has become the cornerstone of many critical applications, where approximate nearest neighbor search (ANNS) queries are often combined with filters on labels such as dates and price ranges. Graph-based indexes achieve state-of-the-art performance on unfiltered ANNS but encounter connectivity breakdown on low-selectivity filtered queries, where qualifying vectors become sparse and the graph structure among them fragments. Recent research proposes specialized graph indexes that address this issue by expanding graph degree, which incurs prohibitively high construction costs. Given these inherent limitations of graph-based methods, we argue for a dual-index architecture and present Curator, a partition-based index that complements existing graph-based approaches for low-selectivity filtered ANNS. Curator builds specialized indexes for different labels within a shared clustering tree, where each index adapts to the distribution of its qualifying vectors to ensure efficient search while sharing structure to minimize memory overhead. The system also supports incremental updates and handles arbitrary complex predicates beyond single-label filters by efficiently constructing temporary indexes on the fly. Our evaluation demonstrates that integrating Curator with state-of-the-art graph indexes reduces low-selectivity query latency by up to 20.9x compared to pre-filtering fallback, while increasing construction time and memory footprint by only 5.5% and 4.3%, respectively.

向量搜索索引优化过滤查询低选择性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。