HONEYBEE通过动态分片实现向量库高效权限控制,兼顾低延迟与低内存开销。
HONEYBEE: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning[Technical Report]
- 基于角色权限结构生成重叠分片,权衡查询速度与内存占用
- 相比逐行安全机制降低13.5倍查询延迟,内存仅增1.24倍
- 适合需细粒度访问控制的企业级向量数据库部署
企业级向量数据库需实施访问控制以保护敏感数据。现有方法在专用用户索引(低延迟但高冗余)与共享索引加后过滤(低内存但高延迟)间存在根本权衡。本文提出HONEYBEE,一种利用角色权限结构(RBAC)的动态分片框架,通过构建重叠分片,在多个分片中策略性复制向量以降低查询延迟并控制内存开销。其建立向量搜索性能与召回率的分析模型,将分片设计转化为带约束的优化问题,平衡内存使用、查询效率与召回率。在RBAC工作负载上的评估表明,相比行级安全方案,查询延迟降低最高达13.5倍,内存增加仅1.24倍;与每角色专属索引相比,性能相当,但额外内存消耗减少90.4%,为安全高效的向量搜索提供实用折中方案。
原文摘要 · Abstract (English)
Enterprise deployments of vector databases require access control policies to protect sensitive data. These systems often implement access control through hybrid vector queries that combine nearest-neighbor search with relational predicates based on user permissions. However, existing approaches face a fundamental trade-off: dedicated per-user indexes minimize query latency but incur high memory redundancy, while shared indexes with post-search filtering reduce memory overhead at the cost of increased latency. This paper introduces HONEYBEE, a dynamic partitioning framework that leverages the structure of Role-Based Access Control (RBAC) policies to create a smooth trade-off between these extremes. RBAC policies organize users into roles and assign permissions at the role level, creating a natural ``thin waist`` in the permission structure that is ideal for partitioning decisions. Specifically, HONEYBEE produces overlapping partitions where vectors can be strategically replicated across different partitions to reduce query latency while controlling memory overhead. To guide these decisions, HONEYBEE develops analytical models of vector search performance and recall, and formulates partitioning as a constrained optimization problem that balances memory usage, query efficiency, and recall. Evaluations on RBAC workloads demonstrate that HONEYBEE achieves up to 13.5X lower query latency than row-level security with only a 1.24X increase in memory usage, while achieving comparable query performance to dedicated, per-role indexes with 90.4% reduction in additional memory consumption, offering a practical middle ground for secure and efficient vector search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。