用大模型直接分析代码,快速精准预测芯片功耗性能面积
RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts
- 用大模型+专家混合架构解析Verilog代码,自动提取特征
- 在10%误差下,面积/延迟/功耗预测准确率提升超13%,速度超30倍
- 适合芯片设计早期评估,省去繁琐手工特征工程
本文提出RocketPPA,一种基于大语言模型的超快速芯片功耗、性能(延迟)和面积(PPA)估算器,直接以HDL代码为输入。核心创新在于将大语言模型(LLM)与由多层感知机组成的专家混合(MoE)架构结合,由LLM理解代码并利用其最后一层隐藏表示进行预测。采用低秩适配(LoRA)实现参数高效微调。同时构建了基于LLM的HDL代码修复框架,生成大规模可综合训练数据集。在VerilogEval基准测试中,相比SOTA方法Llama3-MetRex-8B,RocketPPA在10%相对误差阈值下,面积预测通过率提升13.6%,延迟提升9.4%,功耗提升14.7%;20%阈值下,面积提升9.6%,延迟提升10.8%,功耗提升18.5%。处理速度比MetRex快20倍以上,比MasterRTL快30倍以上。该方法有望显著加速硬件设计流程,实现设计初期精准的PPA评估,避免传统手动特征工程与耗时的综合流程。
原文摘要 · Abstract (English)
This paper presents RocketPPA, a novel ultra-fast power, performance (delay), and area (PPA) estimator operating directly at the code-level abstraction using HDL code as input. The key technical innovation is its LLM-based regression model, which uniquely integrates a large language model (LLM) with a mixture-of-experts (MoE) architecture composed of multilayer perceptrons (MLPs). The LLM interprets the input HDL code and then utilizes its final hidden-layer representations to predict PPA metrics. Low-rank adaptation (LoRA) is used for parameter-efficient fine-tuning to enable efficient LLM training. Furthermore, the work includes the development of an LLM-based HDL code repair framework to generate a large and synthesizable training dataset. Experimental results on the VerilogEval benchmark demonstrate that RocketPPA achieves significant improvements in the accuracy of PPA estimation compared to previous state-of-the-art methods like Llama3-MetRex-8B. Specifically, at a 10% relative error threshold, RocketPPA enhances the pass rate for area prediction by 13.6%, delay by 9.4%, and power by 14.7%. At a 20% threshold, the improvements are 9.6% for area, 10.8% for delay, and 18.5% for power. Moreover, RocketPPA achieves a speedup of over 20x compared to MetRex and 30x over MasterRTL in processing the test set. The impact of RocketPPA is the potential to substantially accelerate the hardware design process by providing accurate PPA estimations early in the design cycle, thus avoiding the overhead of manual feature engineering and time-consuming synthesis flows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。