arXiv:2505.09610cs.ARcs.AI2025-05被引 2

为高性能处理器设计定制专用VHDL代码解释LLM,提升设计效率。

Customizing a Large Language Model for VHDL Design of High-Performance Microprocessors

  • 针对VHDL代码设计特定数据集,通过扩展预训练提升模型理解能力。
  • 专家评估显示模型解释准确率从43%提升至69%,指令微调后达71%。
  • 适用于有多年处理器开发经验的团队,尤其适合硬件AI化转型企业。

近年来,大型语言模型(LLMs)在硬件设计中的应用日益广泛,主要体现在提升芯片设计效率的工具中。尽管Verilog因更受欢迎而受到广泛关注,但作为工业界仍广泛应用的VHDL语言,其在LLM支持方面研究较少。此外,高性能处理器设计组织的独特需求及AI解决方案部署方法也缺乏讨论。本文描述了为解释VHDL代码而开发专用大模型的过程。我们构建了符合实际需求的测试集,用于评估在基线模型上进行扩展预训练(EPT)后的表现。专家评估结果显示,经EPT的模型解释准确率从43%提升至69%。我们进一步开发了‘语言模型作为裁判’机制,模拟专家评估,从而筛选并优化出多个新模型,其中指令微调版本预计可达到71%的专家评分。实验还表明,结合更新的基线模型,该评分有望突破85%。最后,文章讨论了利用生成式AI新进展持续改进硬件设计类LLM的前景。

原文摘要 · Abstract (English)

The use of Large Language Models (LLMs) in hardware design has taken off in recent years, principally through its incorporation in tools that increase chip designer productivity. There has been considerable discussion about the use of LLMs in RTL specifications of chip designs, for which the two most popular languages are Verilog and VHDL. LLMs and their use in Verilog design has received significant attention due to the higher popularity of the language, but little attention so far has been given to VHDL despite its continued popularity in the industry. There has also been little discussion about the unique needs of organizations that engage in high-performance processor design, and techniques to deploy AI solutions in these settings. In this paper, we describe our journey in developing a Large Language Model (LLM) specifically for the purpose of explaining VHDL code, a task that has particular importance in an organization with decades of experience and assets in high-performance processor design. We show how we developed test sets specific to our needs and used them for evaluating models as we performed extended pretraining (EPT) of a base LLM. Expert evaluation of the code explanations produced by the EPT model increased to 69% compared to a base model rating of 43%. We further show how we developed an LLM-as-a-judge to gauge models similar to expert evaluators. This led us to deriving and evaluating a host of new models, including an instruction-tuned version of the EPT model with an expected expert evaluator rating of 71%. Our experiments also indicate that with the potential use of newer base models, this rating can be pushed to 85% and beyond. We conclude with a discussion on further improving the quality of hardware design LLMs using exciting new developments in the Generative AI world.

VHDLLLM定制硬件设计代码解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。