用硬件直连网络层,实现高速低功耗推理,兼顾模型微调能力。
HaShiFlex: A High-Throughput Hardened Shifter DNN Accelerator with Fine-Tuning Flexibility
- 权重采用2的幂次量化,用重连线替代乘法,降低计算开销。
- 在7nm芯片上实现,处理速度达每秒121万张图像,比通用GPU快20倍。
- 保留可重构末层,适合边缘持续感知或数据中心部署场景。
我们提出一种高吞吐神经网络加速器,将大部分网络层直接嵌入硬件,减少数据传输与内存占用,同时通过小型神经处理单元保留分类层的灵活性。利用2的幂次(Po2)量化权重,将乘法替换为简单重连线,使每个卷积仅需加法运算。该设计实现高吞吐、低功耗处理,特别适用于模型参数稳定的场景,如边缘端持续感知或大规模数据中心部署。通过在末尾加入可重构层,系统在保持高吞吐的同时具备微调能力。我们在7nm ASIC流程中以MobileNetV2为基准进行实现,报告了吞吐量、面积、精度及对量化和剪枝的敏感性,验证了该架构的优势与权衡。实验表明,对于MobileNetV2,相比全可编程GPU,推理吞吐提升20倍,每秒处理121万张图像;若无需部署后微调,速度可达67倍,达到每秒400万张图像。
原文摘要 · Abstract (English)
We introduce a high-throughput neural network accelerator that embeds most network layers directly in hardware, minimizing data transfer and memory usage while preserving a degree of flexibility via a small neural processing unit for the final classification layer. By leveraging power-of-two (Po2) quantization for weights, we replace multiplications with simple rewiring, effectively reducing each convolution to a series of additions. This streamlined approach offers high-throughput, energy-efficient processing, making it highly suitable for applications where model parameters remain stable, such as continuous sensing tasks at the edge or large-scale data center deployments. Furthermore, by including a strategically chosen reprogrammable final layer, our design achieves high throughput without sacrificing fine-tuning capabilities. We implement this accelerator in a 7nm ASIC flow using MobileNetV2 as a baseline and report throughput, area, accuracy, and sensitivity to quantization and pruning - demonstrating both the advantages and potential trade-offs of the proposed architecture. We find that for MobileNetV2, we can improve inference throughput by 20x over fully programmable GPUs, processing 1.21 million images per second through a full forward pass while retaining fine-tuning flexibility. If absolutely no post-deployment fine tuning is required, this advantage increases to 67x at 4 million images per second.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。