arXiv:2604.20401cs.CRcs.AI2026-04

Onyx通过重构访问模式,让搜索更省成本且更快。

Onyx: Cost-Efficient Disk-Oblivious ANN Search

论文配图:Onyx: Cost-Efficient Disk-Oblivious ANN Search
图 1 · 摘自论文原文
  • 用紧凑中间表示提前剪枝高带宽访问,降低网络开销
  • 设计局部感知浅层树结构,减少访问次数,提升效率
  • 适合在第三方服务器上保护隐私的高效近似搜索场景

在人工智能系统中,近似最近邻(ANN)搜索越来越多地在第三方基础设施上处理敏感数据。可信执行环境(TEEs)虽能提供保护,但成本效益高的部署需依赖外部SSD,这会因磁盘访问模式泄露用户查询信息。混淆内存(ORAM)可隐藏访问模式,但代价高昂;与现有基于磁盘的ANN搜索技术结合时,对SSD资源利用不佳,导致高延迟和低成本效益。高效磁盘混淆ANN搜索的核心挑战在于平衡带宽与访问次数。当前最优方案在ANN层最小化访问次数,在ORAM层最小化带宽,却相互牺牲,导致整体资源过载。本文提出反向设计:在ANN层最小化带宽消耗,在ORAM层最小化访问次数,因ANN固有的近似性更适合带宽优化,而ORAM无访问次数的理论下限(不同于带宽)。为此,我们提出低成本方案Onyx,包含两个协同设计的新组件:Onyx-ANNS引入紧凑中间表示,主动剪枝大部分高带宽访问,不影响召回率;Onyx-ORAM提出一种局部感知的浅层树结构,减少访问次数,同时兼容高效的带宽型ORAM技术。相比现有最优的混淆式ANN搜索系统,Onyx实现1.7–9.9倍的成本降低和2.3–12.3倍的延迟降低。

原文摘要 · Abstract (English)

Approximate nearest neighbor (ANN) search in AI systems increasingly handles sensitive data on third-party infrastructure. Trusted execution environments (TEEs) offer protection, but cost-efficient deployments must rely on external SSDs, which leaks user queries through disk access patterns to the host. Oblivious RAM (ORAM) can hide these access patterns but at a high cost; when paired with existing disk-based ANN search techniques, it makes poor use of SSD resources, yielding high latency and poor cost-efficiency. The core challenge for efficient oblivious ANN search over SSDs is balancing both bandwidth and access count. The state-of-the-art ORAM-ANN design minimizes access count at the ANN level and bandwidth at the ORAM level, each trading-off the other, leaving the combined system with both resources overutilized. We propose inverting this design, minimizing bandwidth consumption in the ANN layer and access count in the ORAM layer, since each component is better suited for its new role: ANN's inherent approximation allows for more bandwidth efficiency, while ORAM has no fundamental lower bounds on access count (as opposed to bandwidth). To this end, we propose a cost-efficient approach, Onyx, with two new co-designed components: Onyx-ANNS introduces a compact intermediate representation that proactively prunes the majority of bandwidth-intensive accesses without hurting recall, and Onyx-ORAM proposes a locality-aware shallow tree design that reduces access count while remaining compatible with bandwidth-efficient ORAM techniques. Compared to the state-of-the-art oblivious ANN search system, Onyx achieves $1.7-9.9\times$ lower cost and $2.3-12.3\times$ lower latency.

ANN搜索隐私保护SSD优化混淆内存

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。