arXiv:2506.11441cs.ARcs.AI2025-06被引 2

针对AI芯片内存瓶颈,设计高效卷积加速器,能效提升8.6倍。

DPUV4E: High-Throughput DPU Architecture Design for CNN on Versal ACAP

  • 分设卷积与深度可分离计算单元,优化数据复用缓解带宽瓶颈
  • 实测能效达传统FPGA方案8.6倍,资源占用降低超40%
  • 适合高吞吐视觉推理场景,尤其适配深度卷积模型

卷积神经网络在计算机视觉中仍占主导,而基于FPGA的异构加速系统因灵活性与能效优势日益重要。但传统FPGA受限于片上资源,难以兼顾性能与通用性。AMD Versal ACAP专为AI设计,集成AI引擎(AIE)实现高算力,却面临内存带宽不足问题,制约了AIE理论性能发挥。本文提出DPUV4E架构,支持2PE(32.6 TOPS)至8PE(131.0 TOPS)配置。设计卷积处理单元(Conv PE)与深度可分离处理单元(DWC PE),通过高效数据流利用数据复用机会缓解带宽瓶颈。同时扩展PE功能,使AIE可处理非卷积操作,降低资源开销。在50多个模型上的实验表明,相比以往设计,本方案能效提升8.6倍,DSP用量减少95.8%,LUT用量减少44.7%,单批次下延迟降至68.5%。端到端推理中,深度卷积模型吞吐最高提升2.2倍,标准模型提升1.3倍。

原文摘要 · Abstract (English)

Convolutional Neural Networks (CNNs) remain prevalent in computer vision applications, and FPGAs, known for their flexibility and energy efficiency, have become essential components in heterogeneous acceleration systems. However, traditional FPGAs face challenges in balancing performance and versatility due to limited on-chip resources. AMD's Versal ACAP architecture, tailored for AI applications, incorporates AI Engines (AIEs) to deliver high computational power. Nevertheless, the platform suffers from insufficient memory bandwidth, hindering the full utilization of the AIEs' theoretical performance. In this paper, we present DPUV4E for the Versal architecture, providing configurations ranging from 2PE ($32.6$ TOPS) to 8PE ($131.0$ TOPS). We design two computation units, Conv PE and DWC PE, to support different computational patterns. Each computation unit's data flow efficiently utilizes the data reuse opportunities to mitigate bandwidth bottlenecks. Additionally, we extend the functionality of each PE to utilize AIEs for non-convolutional operations, reducing resource overhead. Experiments on over 50 models show that compared to previous designs, our design provides $8.6\times$ the TOPS/W of traditional FPGA-based DPU designs, while reducing DSP usage by $95.8\%$, LUT usage by $44.7\%$, and latency to $68.5\%$ under single-batch conditions. For end-to-end inference, our design improving throughput by up to $2.2\times$ for depth-wise convolution models and up to $1.3\times$ for standard models.

AI加速FPGA卷积优化能效提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。