提出混合存内计算架构,让内存同时支持模拟与数字运算。
DARTH-PUM: A Hybrid Processing-Using-Memory Architecture
- 融合模拟与数字存内计算,用专用电路协调两种运算
- 在三种应用中实现最高59.4倍加速,能处理加密、神经网络等任务
- 适合嵌入式到大规模数据计算,编程接口简单易用
模拟存内计算(PUM)利用存储阵列内的电学交互执行大规模矩阵-向量乘法(MVM),但许多常用核函数需非MVM操作,而模拟PUM无法直接支持。为保持能效,现有架构通过添加基于CMOS的专用硬件来补全功能,但其与存储阵列集成困难,使模拟PUM主要局限于机器学习推理或近似核函数。近期研究发现,存储阵列也可执行布尔型PUM操作,仅需不同硬件和电信号。我们提出DARTH-PUM,一种通用混合存内计算架构,解决硬件与软件集成难题:设计优化外围电路,协调两类PUM的管理与接口,提供易用编程接口,并支持灵活数据宽度。该设计使完全在内存中执行核函数成为可能,且可轻松扩展至从嵌入式应用到大规模数据计算场景。我们展示三个典型应用——AES加密、卷积神经网络、大语言模型——均可映射至DARTH-PUM,相比模拟+CPU基线分别获得59.4×、14.8×、40.8×加速。
原文摘要 · Abstract (English)
Analog processing-using-memory (PUM; a.k.a. in-memory computing) makes use of electrical interactions inside memory arrays to perform bulk matrix-vector multiplication (MVM) operations. However, many popular matrix-based kernels need to execute non-MVM operations, which analog PUM cannot directly perform. To retain its energy efficiency, analog PUM architectures augment memory arrays with CMOS-based domain-specific fixed-function hardware to provide complete kernel functionality, but the difficulty of integrating such specialized CMOS logic with memory arrays has largely limited analog PUM to being an accelerator for machine learning inference, or for closely related kernels. An opportunity exists to harness analog PUM for general-purpose computation: recent works have shown that memory arrays can also perform Boolean PUM operations, albeit with very different supporting hardware and electrical signals than analog PUM. We propose DARTH-PUM, a general-purpose hybrid PUM architecture that tackles key hardware and software challenges to integrating analog PUM and digital PUM. We propose optimized peripheral circuitry, coordinating hardware to manage and interface between both types of PUM, an easy-to-use programming interface, and low-cost support for flexible data widths. These design elements allow us to build a practical PUM architecture that can execute kernels fully in memory, and can scale easily to cater to domains ranging from embedded applications to large-scale data-driven computing. We show how three popular applications (AES encryption, convolutional neural networks, large language models) can map to and benefit from DARTH-PUM, with speedups of 59.4x, 14.8x, and 40.8x over an analog+CPU baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。