OpenGeMM提升边缘设备矩阵乘法效率,兼顾高利用率与易编程性。
OpenGeMM: A High-Utilization GeMM Accelerator Generator with Lightweight RISC-V Control and Tight Memory Coupling
- 基于Chisel的可配置GeMM加速器,搭配轻量RISC-V与紧耦合内存
- 在多种模型上实现81.89%~99.34%硬件利用率,最高提速16.4倍
- 适合需要高效、灵活部署的边缘AI应用开发者
深度神经网络在资源受限的极端边缘设备上部署面临计算与数据密集的挑战。独立加速器虽适配特定场景但控制僵化,通用平台结合RISC-V CPU虽具灵活性却常牺牲系统效率与利用率。为此,我们提出OpenGeMM——一个开源加速平台,兼具高效能与高可配置性。其包含参数化Chisel编码的GeMM加速器、轻量级RISC-V处理器及紧密耦合的多银行缓存。通过配置预加载、输入预取加输出缓冲、可编程步进访问三机制,显著提升GeMM核心利用率与系统效率。实验表明,OpenGeMM在各类CNN与Transformer工作负载下,硬件利用率稳定在81.89%至99.34%之间。相比当前最优开源Gemmini加速器,在多样化GeMM任务中实现3.58倍至16.40倍的归一化吞吐提速,系统能效达4.68 TOPS/W。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) face significant challenges when deployed on resource-constrained extreme edge devices due to their computational and data-intensive nature. While standalone accelerators tailored for specific application scenarios suffer from inflexible control and limited programmability, generic hardware acceleration platforms coupled with RISC-V CPUs can enable high reusability and flexibility, yet typically at the expense of system level efficiency and low utilization. To fill this gap, we propose OpenGeMM, an open-source acceleration platform, jointly demonstrating high efficiency and utilization, as well as ease of configurability and programmability. OpenGeMM encompasses a parameterized Chisel-coded GeMM accelerator, a lightweight RISC-V processor, and a tightly coupled multi-banked scratchpad memory. The GeMM core utilization and system efficiency are boosted through three mechanisms: configuration pre-loading, input pre-fetching with output buffering, and programmable strided memory access. Experimental results show that OpenGeMM can consistently achieve hardware utilization ranging from 81.89% to 99.34% across diverse CNN and Transformer workloads. Compared to the SotA open-source Gemmini accelerator, OpenGeMM demonstrates a 3.58x to 16.40x speedup on normalized throughput across a wide variety ofGeMM workloads, while achieving 4.68 TOPS/W system efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。