arXiv:2505.05885cs.DBcs.IR2025-05被引 7

将DiskANN集成到Azure Cosmos DB,实现低成本低延迟向量搜索。

Cost-Effective, Low Latency Vector Search with Azure Cosmos DB

  • 在分布式数据库中嵌入DiskANN索引,每分区仅用一个索引。
  • 1000万向量上查询延迟低于20ms,召回率稳定且成本比Pinecone低43倍。
  • 适合需要高可用、可扩展的向量搜索系统开发者使用。

向量索引使跨多样语料库的语义搜索成为可能,已成为用户和AI代理与数据库交互的重要接口。高效向量搜索需数据库系统深度优化。这催生了专为向量搜索设计的新一代向量数据库,以优化搜索质量与成本。我们主张,可在一个云原生操作型数据库如Azure Cosmos DB中构建可扩展、高性能且成本高效的向量搜索系统,同时利用分布式数据库的高可用性、持久性和可扩展性优势。为此,我们深度集成最先进的向量索引库DiskANN至Azure Cosmos DB NoSQL。该系统在每个分区内使用单个向量索引,存储于现有索引树中,并与底层数据保持同步。它在覆盖1000万向量的索引上实现<20ms查询延迟,更新过程中召回率稳定,并相比Pinecone和Zilliz的无服务器企业产品分别降低约43倍和12倍查询成本。通过自动分片,系统可扩展至数十亿向量。这一融合设计支持将向量索引整合进操作型数据库,为当前关于专用向量数据库的讨论提供新视角,也为其他数据库的向量索引实现提供范例。

原文摘要 · Abstract (English)

Vector indexing enables semantic search over diverse corpora and has become an important interface to databases for both users and AI agents. Efficient vector search requires deep optimizations in database systems. This has motivated a new class of specialized vector databases that optimize for vector search quality and cost. Instead, we argue that a scalable, high-performance, and cost-efficient vector search system can be built inside a cloud-native operational database like Azure Cosmos DB while leveraging the benefits of a distributed database such as high availability, durability, and scale. We do this by deeply integrating DiskANN, a state-of-the-art vector indexing library, inside Azure Cosmos DB NoSQL. This system uses a single vector index per partition stored in existing index trees, and kept in sync with underlying data. It supports < 20ms query latency over an index spanning 10 million vectors, has stable recall over updates, and offers approximately 43x and 12x lower query cost compared to Pinecone and Zilliz serverless enterprise products. It also scales out to billions of vectors via automatic partitioning. This convergent design presents a point in favor of integrating vector indices into operational databases in the context of recent debates on specialized vector databases, and offers a template for vector indexing in other databases.

向量搜索Azure Cosmos DBDiskANN低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。