arXiv:2409.07832cs.ARcs.LG2024-09被引 3

用新型编码与搜索方法,大幅提升海量类别少样本学习的向量检索效率与准确率。

Efficient and Reliable Vector Similarity Search Using Asymmetric Encoding with NAND-Flash for Many-Class Few-Shot Learning

  • 采用分层编码和非对称搜索,降低查询向量精度以减少计算量。
  • 在多类少样本场景下,搜索迭代次数最多减少32倍,准确率提升1.58%~6.94%。
  • 针对闪存硬件特性优化训练,提升系统可靠性,适合嵌入式低功耗部署。

尽管基于外部记忆的神经网络(MANNs)通过结合深度神经网络与外部记忆,为少样本学习(FSL)提供了有效方案,但在多类少样本场景中,大量支持向量导致存储容量需求和数据搬运能耗急剧上升。为提升MANNs能效,多种内存内搜索方案应运而生。基于NAND的多比特内容可寻址内存(MCAM)因其高密度与大容量成为可行选择。然而,MCAM受限于有限的字线数量、量化等级以及串扰电流、瓶颈效应等非理想因素,导致显著精度下降。为此,本文提出三项创新:首先,多比特热码(MTMC)利用MCAM的广阔容量,通过累积编码规则提升向量精度,缓解瓶颈效应;其次,非对称向量相似性搜索(AVSS)降低查询向量精度,同时保持支持向量精度,从而减少搜索迭代次数,提升多类场景效率;最后,硬件感知训练(HAT)通过建模MCAM硬件特性优化控制器训练,增强系统可靠性。所提集成框架将搜索迭代次数减少最高达32倍,整体准确率提升1.58%至6.94%。

原文摘要 · Abstract (English)

While memory-augmented neural networks (MANNs) offer an effective solution for few-shot learning (FSL) by integrating deep neural networks with external memory, the capacity requirements and energy overhead of data movement become enormous due to the large number of support vectors in many-class FSL scenarios. Various in-memory search solutions have emerged to improve the energy efficiency of MANNs. NAND-based multi-bit content addressable memory (MCAM) is a promising option due to its high density and large capacity. Despite its potential, MCAM faces limitations such as a restricted number of word lines, limited quantization levels, and non-ideal effects like varying string currents and bottleneck effects, which lead to significant accuracy drops. To address these issues, we propose several innovative methods. First, the Multi-bit Thermometer Code (MTMC) leverages the extensive capacity of MCAM to enhance vector precision using cumulative encoding rules, thereby mitigating the bottleneck effect. Second, the Asymmetric vector similarity search (AVSS) reduces the precision of the query vector while maintaining that of the support vectors, thereby minimizing the search iterations and improving efficiency in many-class scenarios. Finally, the Hardware-Aware Training (HAT) method optimizes controller training by modeling the hardware characteristics of MCAM, thus enhancing the reliability of the system. Our integrated framework reduces search iterations by up to 32 times, and increases overall accuracy by 1.58% to 6.94%.

少样本学习向量检索MCAM硬件优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。