为EDA领域定制大模型训练框架,提升专业问答与知识检索能力。
ChipLingo: A Systematic Training Framework for Large Language Models in EDA

- 构建多源数据集并增强问答对,系统化提升模型领域理解力。
- 8B模型在EDA-Bench上达59.7%准确率,32B模型达70.02%,接近商用水平。
- 显式模拟检索场景训练,有效缓解领域微调后检索性能下降问题。
随着半导体技术的快速发展,电子设计自动化(EDA)正演变为高度知识密集且依赖文档的工程领域。尽管大语言模型具备强大通用能力,但直接应用于EDA仍面临领域专长不足、跨工具知识混淆及领域微调后检索增强生成(RAG)性能下降等问题。为此,本文提出ChipLingo,一个面向EDA场景的系统化大模型训练框架,包含三个阶段:基于多源数据整合与问答增强的领域语料构建、不同参数训练策略对比的领域自适应预训练,以及在多种检索条件下进行指令对齐的RAG场景训练。我们还构建了内部基准EDA-Bench,覆盖典型EDA工具场景,计划公开。实验表明,ChipLingo-8B在EDA-Bench上达到59.7%准确率,优于同规模基线模型及部分更大通用模型;ChipLingo-32B达70.02%,接近领先闭源商用模型。分析显示,问答增强提升领域表现,部分微调(Partial FT)在适应性与通用能力保留间更优,显式RAG训练可缓解微调后检索利用率下降。结果证明系统化领域训练对知识密集型EDA任务具有实用价值,为未来EDA智能体与外部知识驱动系统奠定基础。
原文摘要 · Abstract (English)
With the rapid advancement of semiconductor technology, Electronic Design Automation (EDA) has become an increasingly knowledge-intensive and document-driven engineering domain. Although large language models (LLMs) have shown strong general capabilities, applying them directly to EDA remains challenging due to limited domain expertise, cross-tool knowledge confusion, and degraded retrieval-augmented generation (RAG) performance after domain training. To address these issues, this paper presents ChipLingo, a systematic training pipeline for domain-adapted LLMs tailored to EDA scenarios. ChipLingo consists of three stages: domain corpus construction with multi-source data curation and QA augmentation, domain-adaptive pretraining with comparisons of different parameter training strategies, and instruction alignment with RAG scenario training under diverse retrieval conditions. We also curate an internal benchmark, EDA-Bench, covering representative EDA tool scenarios, with plans for public release. Experiments show that ChipLingo-8B achieves 59.7% accuracy on EDA-Bench, outperforming the same-scale base model and some larger general-purpose models. ChipLingo-32B reaches 70.02%, approaching leading closed-source commercial models. Further analysis shows that QA augmentation improves domain performance, Partial FT offers a better balance between adaptation and general capability retention than LoRA, and explicit RAG scenario training mitigates the decline in retrieval utilization after domain training. These results demonstrate the practical value of systematic domain training for knowledge-intensive EDA tasks and provide a foundation for future EDA agents and external-knowledge-driven systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。