arXiv:2509.12053cs.ARcs.AI2025-09被引 3

自动生成可合成的张量加速器架构,提升AI模型运行效率

LEGO: Spatial Accelerator Generation and Optimization for Tensor Applications

  • 基于仿射变换表示法自动设计空间架构与内存系统
  • 相比Gemmini提升3.2倍速度和2.4倍能效
  • 适配多种生成式AI模型,无需手工编写RTL代码

现代张量应用,尤其是基础模型和生成式AI应用,需要支持多模态输入(视觉与语言),这对加速器架构的灵活性提出了更高要求。现有框架在设计灵活性与RTL生成效率之间存在权衡:要么仅限于少数手工编写的模板,要么无法自动生成功能代码。为此,我们提出LEGO框架,专为张量应用设计,可自动生成空间架构并输出可综合的RTL代码,无需手工编写RTL模板。LEGO前端利用基于仿射变换的架构表示法,分析功能单元间的连接关系,合成内存系统,并根据数据重用分析融合不同的空间数据流设计。后端将硬件表示为底层原语图,进行低层级优化,并采用一系列线性规划算法,最优插入流水寄存器,减少切换数据流时未使用逻辑的开销。评估表明,LEGO相比先前工作Gemmini实现3.2倍加速和2.4倍能效提升,并能为多种生成式AI应用中的现代基础模型生成统一架构。

原文摘要 · Abstract (English)

Modern tensor applications, especially foundation models and generative AI applications require multiple input modalities (both vision and language), which increases the demand for flexible accelerator architecture. Existing frameworks suffer from the trade-off between design flexibility and productivity of RTL generation: either limited to very few hand-written templates or cannot automatically generate the RTL. To address this challenge, we propose the LEGO framework, which targets tensor applications and automatically generates spatial architecture design and outputs synthesizable RTL code without handwritten RTL design templates. Leveraging the affine-transformation-based architecture representation, LEGO front end finds interconnections between function units, synthesizes the memory system, and fuses different spatial dataflow designs based on data reuse analysis. LEGO back end then translates the hardware in a primitive-level graph to perform lower-level optimizations, and applies a set of linear-programming algorithms to optimally insert pipeline registers and reduce the overhead of unused logic when switching spatial dataflows. Our evaluation demonstrates that LEGO can achieve 3.2x speedup and 2.4x energy efficiency compared to previous work Gemmini, and can generate one architecture for diverse modern foundation models in generative AI applications.

张量加速器自动架构生成生成式AIRTL优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。