arXiv:2507.21394cs.LGcs.SY2025-07被引 1

专为长序列建模设计的硬件加速器,显著提升状态空间模型推理效率。

Systolic Array-based Accelerator for Structured State-Space Models

  • 基于流水线阵列架构,设计通用计算单元支持传统与状态空间模型
  • 在LRA数据集上相比GPU提升2000倍性能,能效提升45倍
  • 适合需要处理超长序列的AI应用,如语音、基因组分析

序列建模对理解时间数据和识别复杂时序模式至关重要。尽管循环神经网络(RNN)、卷积神经网络(CNN)和Transformer在捕捉长程依赖方面取得进展,但受限于固定上下文窗口,难以高效处理极长序列。状态空间模型(SSMs)通过指数衰减记忆机制,支持更长的上下文窗口,从而更高效地处理长序列。然而,与传统神经网络不同,SSM需通过连续积分求解微分方程,导致训练和推理在通用CPU/GPU上均存在高算力和高内存开销。本文提出专用硬件加速器EpochCore,基于流水线阵列(SAs)设计,旨在提升基于SSM模型的推理能效与吞吐量。其核心是名为LIMA-PE的多功能处理单元,可执行传统与专用乘加运算,兼容DNN与SSM。同时提出新型数据流ProDF,实现高效执行。结合LIMA-PE与ProDF,EpochCore在LRA数据集上相较GPU平均提升2000倍性能,相较传统基于SA的加速器(TPU)提升250倍性能与45倍能效。

原文摘要 · Abstract (English)

Sequence modeling is crucial for AI to understand temporal data and detect complex time-dependent patterns. While recurrent neural networks (RNNs), convolutional neural networks (CNNs), and Transformers have advanced in capturing long-range dependencies, they struggle with achieving high accuracy with very long sequences due to limited memory retention (fixed context window). State-Space Models (SSMs) leverage exponentially decaying memory enabling lengthy context window and so they process very long data sequences more efficiently than recurrent and Transformer-based models. Unlike traditional neural models like CNNs and RNNs, SSM-based models require solving differential equations through continuous integration, making training and inference both compute- and memory-intensive on conventional CPUs and GPUs. In this paper we introduce a specialized hardware accelerator, EpochCore, for accelerating SSMs. EpochCore is based on systolic arrays (SAs) and is designed to enhance the energy efficiency and throughput of inference of SSM-based models for long-range sequence tasks. Within the SA, we propose a versatile processing element (PE) called LIMA-PE to perform traditional and specialized MAC operations to support traditional DNNs and SSMs. To complement the EpochCore microarchitecture, we propose a novel dataflow, ProDF, which enables highly efficient execution of SSM-based models. By leveraging the LIMA-PE microarchitecture and ProDF, EpochCore achieves on average 2000x improvement in performance on LRA datasets compared to a GPU and 250x gains in performance and 45x improvement in energy efficiency, over traditional SA-based accelerators (TPU).

硬件加速状态空间模型长序列建模流水线阵列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。