用自适应高斯分区提升高维近邻搜索效率
GARLIC: GAussian Representation LearnIng for spaCe partitioning
- 基于局部几何与密度自适应的非球形分区
- 小探查预算下候选点数量减少30%以上
- 适合数据分布不均的高维检索场景
我们提出GARLIC,一种面向高维欧氏近似最近邻(ANN)搜索的表征学习方法。现有划分多依赖各向同性单元、固定全局分辨率或平衡约束,导致稠密区域碎片化、稀疏区域误合并,从而在仅探测少数单元时增加候选数。GARLIC将ℝ^d划分为与局部几何对齐、大小随数据密度自适应的各向异性高斯单元。通过信息论目标平衡覆盖度、重叠度与几何对齐性,分裂/克隆精炼机制仅在必要处引入新高斯单元。查询时,马哈拉诺比斯距离选择相关单元,局部量化剪枝候选。结果表明,在小探查预算下,该方法显著减少跨单元邻居分裂和候选数,且在仅使用数据集小部分训练时仍保持鲁棒性。整体上,GARLIC引入了一种融合信息论目标与自适应密度精炼的几何感知空间划分范式,为欧氏ANN搜索提供了具有竞争力的召回率-效率权衡。
原文摘要 · Abstract (English)
We present \textbf{GARLIC}, a representation learning approach for Euclidean approximate nearest neighbor (ANN) search in high dimensions. Existing partitions tend to rely on isotropic cells, fixed global resolution, or balanced constraints, which fragment dense regions and merge unrelated points in sparse ones, thereby increasing the candidate count when probing only a few cells. Our method instead partitions \(\mathbb{R}^d\) into anisotropic Gaussian cells whose shapes align with local geometry and sizes adapt to data density. Information-theoretic objectives balance coverage, overlap, and geometric alignment, while split/clone refinement introduces Gaussians only where needed. At query time, Mahalanobis distance selects relevant cells and localized quantization prunes candidates. This yields partitions that reduce cross-cell neighbor splits and candidate counts under small probe budgets, while remaining robust even when trained on only a small fraction of the dataset. Overall, GARLIC introduces a geometry-aware space-partitioning paradigm that combines information-theoretic objectives with adaptive density refinement, offering competitive recall--efficiency trade-offs for Euclidean ANN search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。