通过融合乘加运算,提升FPGA上CNN加速器能效与速度。
Energy-Efficient CNN Acceleration with MSDF Digit-Serial Arithmetic on FPGA

- 将乘法与加法合并为单一流水线,减少启动延迟。
- 相比传统设计,能效达15.14 GOPS/W,提升超8倍。
- 适合医疗影像等对功耗和延迟敏感的边缘场景。
本文提出一种面向图像分割U-Net架构卷积层的节能FPGA硬件加速方案。尽管最显著位优先(MSDF)数字串行算术具有紧凑的硬件面积优势,但在级联操作如乘加中存在初始延迟累积问题。为此,我们设计了融合乘加(MMA)架构,将两个操作合并为统一流水线,仅引入一次延迟,低于传统级联单元的总延迟,从而提升吞吐量与能效。MMA单元并行处理空间输入深度,性能远超独立的MSDF设计与常规方案。在以U-Net为目标应用的评估中,尽管工作频率低于CPU,该FPGA加速器实现高达15.14 GOPS/W的能效,相较CPU的1.93 GOPS/W提升约8倍;与现有MSDF FPGA实现相比,能耗降低约9倍。结果表明,该融合算术方法在资源受限、低延迟敏感的医疗影像与计算机视觉边缘应用中极具有效性。
原文摘要 · Abstract (English)
This paper presents an energy-efficient hardware acceleration of the convolutional layers in the U-Net architecture for image segmentation, implemented on FPGA. While digit-serial arithmetic, particularly most-significant-digit-first (MSDF) techniques, offers a compact hardware footprint, it suffers from initial latency before producing the first output digit. This delay accumulates in cascaded operations like multiplication followed by addition, where each unit introduces its own startup overhead. To overcome this, we propose a merged multiply-add (MMA) architecture that fuses these operations into a unified pipeline. Instead of incurring separate delays, the MMA introduces a single streamlined latency per iteration, shorter than the combined latency of conventional cascaded units, resulting in enhanced throughput and efficiency. The MMA units are designed to process spatial input depths in parallel, achieving significantly higher performance than both standalone MSDF-based and conventional designs. We evaluate the proposed design using U-Net as a target application. Despite operating at a lower frequency than a CPU, the FPGA-based accelerator achieves up to an order of magnitude higher energy efficiency, delivering up to $15.14$ GOPS/W compared to $1.93$ GOPS/W for CPU-based inference. The design also shows approximately $9\times$ reduction in energy consumption compared to MSDF-based FPGA implementations. These results highlight the efficacy of the merged arithmetic approach for resource-constrained, latency-sensitive edge applications in medical imaging and computer vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。