用进化算法让大模型自动优化Verilog代码,不依赖人工干预。
EvoVerilog: Large Langugage Model Assisted Evolution of Verilog Code
- 结合大模型推理与进化算法,无须人工参与生成代码。
- 在两个基准上达89.1和80.2的pass@10,性能领先。
- 可同时生成多样且资源高效的设计,适合自动化硬件设计。
大语言模型(LLMs)在自动生成Verilog硬件描述语言代码方面展现出巨大潜力,有助于降低复杂且易出错的硬件设计中的人工成本。然而,现有方法大多依赖人工干预和精心构建的数据集微调,限制了其在自动化设计流程中的可扩展性。尽管近期出现了迭代搜索技术,但常无法探索多样化设计解决方案,甚至不如简单的重复提示方法。为此,我们提出EvoVerilog,一种将大模型推理能力与进化算法相结合的新框架,以自动生成和优化Verilog代码。EvoVerilog采用多目标、种群为基础的搜索策略,在无需人工干预的情况下广泛探索设计可能性。大量实验表明,该框架在VerilogEval-Machine和VerilogEval-Human基准上的pass@10得分分别达到89.1和80.2,处于当前最优水平。此外,该框架还能同时生成多种功能性代码,并优化资源利用,展现多样化设计探索能力。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated great potential in automating the generation of Verilog hardware description language code for hardware design. This automation is critical to reducing human effort in the complex and error-prone process of hardware design. However, existing approaches predominantly rely on human intervention and fine-tuning using curated datasets, limiting their scalability in automated design workflows. Although recent iterative search techniques have emerged, they often fail to explore diverse design solutions and may underperform simpler approaches such as repeated prompting. To address these limitations, we introduce EvoVerilog, a novel framework that combines the reasoning capabilities of LLMs with evolutionary algorithms to automatically generate and refine Verilog code. EvoVerilog utilizes a multiobjective, population-based search strategy to explore a wide range of design possibilities without requiring human intervention. Extensive experiments demonstrate that EvoVerilog achieves state-of-the-art performance, with pass@10 scores of 89.1 and 80.2 on the VerilogEval-Machine and VerilogEval-Human benchmarks, respectively. Furthermore, the framework showcases its ability to explore diverse designs by simultaneously generating a variety of functional Verilog code while optimizing resource utilization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。