arXiv:2504.05573cs.DBcs.AI2025-04被引 15

轻量级本地向量数据库,支持设备端高效更新与混合查询。

MicroNN: An On-device Disk-resident Updatable Vector Database

  • 基于磁盘的索引结构,内存占用低至10MB
  • 百万级向量检索延迟低于7毫秒,召回率达90%
  • 适用于需要频繁增删改的设备端向量搜索场景

密集向量集合的最近邻搜索在信息检索、检索增强生成(RAG)和内容排序中有重要应用。尽管大规模向量集合的高效搜索已有诸多研究和开源实现,但多数先进系统面向的是内存充足、静态向量集且仅执行纯最近邻搜索的服务器场景。本文提出MicroNN,一个专为资源受限环境设计的嵌入式最近邻向量搜索引擎,支持设备端可更新的向量集合与结合结构化属性过滤的混合查询。在内存极度受限的条件下,需兼顾磁盘高效的索引结构与算法,并支持持续插入与删除操作。MicroNN是一个可嵌入的库,可在极低资源下扩展至大规模向量集合。已在生产环境中部署,支撑多种设备端向量搜索应用。在公开的百万级向量基准测试中,其检索前100个最近邻耗时小于7毫秒,召回率可达90%,仅使用约10MB内存。

原文摘要 · Abstract (English)

Nearest neighbour search over dense vector collections has important applications in information retrieval, retrieval augmented generation (RAG), and content ranking. Performing efficient search over large vector collections is a well studied problem with many existing approaches and open source implementations. However, most state-of-the-art systems are generally targeted towards scenarios using large servers with an abundance of memory, static vector collections that are not updatable, and nearest neighbour search in isolation of other search criteria. We present Micro Nearest Neighbour (MicroNN), an embedded nearest-neighbour vector search engine designed for scalable similarity search in low-resource environments. MicroNN addresses the problem of on-device vector search for real-world workloads containing updates and hybrid search queries that combine nearest neighbour search with structured attribute filters. In this scenario, memory is highly constrained and disk-efficient index structures and algorithms are required, as well as support for continuous inserts and deletes. MicroNN is an embeddable library that can scale to large vector collections with minimal resources. MicroNN is used in production and powers a wide range of vector search use-cases on-device. MicroNN takes less than 7 ms to retrieve the top-100 nearest neighbours with 90% recall on publicly available million-scale vector benchmark while using ~10 MB of memory.

向量数据库设备端可更新低内存

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。