用脊髓机制加速脑启发模型的快速反应,提升物联网数据处理效率
Enhancing Biologically Inspired Hierarchical Temporal Memory with Hardware-Accelerated Reflex Memory
- 引入反射记忆模块,专攻一阶时序推理,降低计算开销
- 硬件加速后推理速度达0.094秒,比原模型快10倍以上
- 适合需要低延迟响应的实时物联网场景
物联网快速发展产生海量数据,亟需高效无监督学习系统。层级时间记忆(HTM)模拟人脑新皮层,通过神经元柱处理和预测序列,支持多阶推断。然而多阶推断带来显著计算负担,其核心组件序列记忆(SM)因复杂可编程互连而成为瓶颈。研究发现,一阶时序关系常已足够,无需牺牲效率。本文提出受脊髓机制启发的反射记忆(RM)模块,专门加速一阶推理。将RM与HTM结合形成加速层级时间记忆(AHTM),在保持多阶推断能力的同时更高效处理重复信息。实验表明,原HTM预测事件耗时0.945秒,AHTM仅需0.125秒;采用内容寻址存储器(CAM)实现的硬件加速版H-AHTM进一步缩短至0.094秒。相比原算法,AHTM提速最高达7.55倍,H-AHTM达10.10倍。
原文摘要 · Abstract (English)
The rapid expansion of the Internet of Things (IoT) generates zettabytes of data that demand efficient unsupervised learning systems. Hierarchical Temporal Memory (HTM), a third-generation unsupervised AI algorithm, models the neocortex of the human brain by simulating columns of neurons to process and predict sequences. These neuron columns can memorize and infer sequences across multiple orders. While multiorder inferences offer robust predictive capabilities, they often come with significant computational overhead. The Sequence Memory (SM) component of HTM, which manages these inferences, encounters bottlenecks primarily due to its extensive programmable interconnects. In many cases, it has been observed that first-order temporal relationships have proven to be sufficient without any significant loss in efficiency. This paper introduces a Reflex Memory (RM) block, inspired by the Spinal Cord's working mechanisms, designed to accelerate the processing of first-order inferences. The RM block performs these inferences significantly faster than the SM. The integration of RM with HTM forms a system called the Accelerated Hierarchical Temporal Memory (AHTM), which processes repetitive information more efficiently than the original HTM while still supporting multiorder inferences. The experimental results demonstrate that the HTM predicts an event in 0.945 s, whereas the AHTM module does so in 0.125 s. Additionally, the hardware implementation of RM in a content-addressable memory (CAM) block, known as Hardware-Accelerated Hierarchical Temporal Memory (H-AHTM), predicts an event in just 0.094 s, significantly improving inference speed. Compared to the original algorithm \cite{bautista2020matlabhtm}, AHTM accelerates inference by up to 7.55x, while H-AHTM further enhances performance with a 10.10x speedup.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。