用大模型自动设计FPGA加速器,省时省力还高效
Towards Autonomous Accelerator Design: FPGA Accelerator Generation with SECDA

- 结合大模型与系统级仿真,智能探索硬件配置空间
- 在FPGA上成功部署3种算子加速器,性能匹配手工设计
- 适合希望降低硬件设计门槛的AI工程师和研究者
针对现代AI工作负载的FPGA加速器设计需在复杂硬件空间中权衡架构参数、数据流策略与内存层级,耗时且依赖经验。现有方法如SECDA虽能通过SystemC仿真与FPGA执行实现软硬协同快速设计,但高效配置仍需大量人工试错。本文提出SECDA-DSE框架,将大语言模型(LLM)融入SECDA生态,通过结构化设计空间探索器生成候选架构,结合检索增强生成与思维链提示的LLM栈进行推理引导探索,并引入反馈机制实现迭代优化。基于前期工作,本研究扩展评估范围,生成了逐元素向量乘法、2D卷积和矩阵转置三种加速器,完成端到端FPGA部署。结果表明,SECDA-DSE可生成符合SECDA规范、成功合成并运行于FPGA的加速器设计;所生成方案能有效捕捉不同算子在计算并行性与数据搬运间的权衡,验证了大模型引导探索在跨工作负载自适应配置方面的潜力,显著减少探索时间与人工经验依赖。
原文摘要 · Abstract (English)
Designing FPGA-based accelerators for modern artificial intelligence workloads requires exploring a large and complex hardware design space that involves architectural parameters, data flow strategies, and memory hierarchies, making the process very time consuming. While existing methodologies such as SECDA enable rapid hardware-software co-design through SystemC simulation and FPGA execution, identifying efficient accelerator configurations remains a largely manual process requiring extensive domain knowledge. SECDA-DSE is a framework that integrates Large Language Models (LLMs) into the SECDA ecosystem to guide design space exploration (DSE) of FPGA-based accelerators. It combines a structured DSE Explorer for generating candidate architectures with an LLM Stack that performs reasoning-guided exploration using retrieval-augmented generation and chain-of-thought prompting, coupled with a feedback loop for iterative and reinforced refinement. Building on our previous work introducing SECDA-DSE, this paper extends its evaluation by generating three accelerator designs, including element-wise vector multiplication, 2D convolution, and matrix transpose, and performing end-to-end execution on FPGA hardware. The results show that SECDA-DSE can generate SECDA-compliant accelerator designs that are successfully synthesized and executed on FPGA hardware. Furthermore, the generated designs capture kernel-specific trade-offs between compute parallelism and data movement, highlighting the potential of LLM-guided exploration to adapt architectural configurations across diverse workloads while reducing exploration time and the need for extensive human expertise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。