提出电路基础模型新范式,推动AI在芯片设计中从专用到通用的转变。
A Survey of Circuit Foundation Model: Foundation AI Models for VLSI Circuit Design and EDA
- 分两阶段训练:先无监督预训练学电路本质特征,再微调适配具体任务。
- 覆盖130+篇2022年后论文,90%为近年成果,反映该领域快速兴起。
- 按编码器/解码器结构分类,聚焦电路数据特性与生成能力的应用。
人工智能驱动的电子设计自动化(EDA)技术已在超大规模集成电路(VLSI)设计中广泛应用。近年来,电路基础模型(CFMs)作为一种新兴技术趋势崭露头角。不同于传统任务特定的AI方案,这类模型通过两阶段流程构建:首先在大量未标注数据上进行自监督预训练,以学习电路的内在属性;其次通过高效微调适配具体下游任务,如早期设计质量评估、电路相关上下文生成和功能验证。该范式带来模型泛化性强、对标注数据依赖低、任务迁移高效及前所未有的生成能力等优势。本文首次将此类模型统一命名为电路基础模型(CFMs),系统综述了其最新进展,涵盖超过130篇相关工作,其中90%以上发表于2022年或之后,凸显该方向的迅猛发展。我们将其分为两大类:基于编码器的方法,用于电路表征学习与预测任务;基于解码器的方法,利用大语言模型(LLMs)实现生成任务。文章还分析了电路数据的独特属性,这些特性催生了众多创新方法,并使其区别于通用人工智能技术。
原文摘要 · Abstract (English)
Artificial intelligence (AI)-driven electronic design automation (EDA) techniques have been extensively explored for VLSI circuit design applications. Most recently, foundation AI models for circuits have emerged as a new technology trend. Unlike traditional task-specific AI solutions, these new AI models are developed through two stages: 1) self-supervised pre-training on a large amount of unlabeled data to learn intrinsic circuit properties; and 2) efficient fine-tuning for specific downstream applications, such as early-stage design quality evaluation, circuit-related context generation, and functional verification. This new paradigm brings many advantages: model generalization, less reliance on labeled circuit data, efficient adaptation to new tasks, and unprecedented generative capability. In this paper, we propose referring to AI models developed with this new paradigm as circuit foundation models (CFMs). This paper provides a comprehensive survey of the latest progress in circuit foundation models, unprecedentedly covering over 130 relevant works. Over 90% of our introduced works were published in or after 2022, indicating that this emerging research trend has attracted wide attention in a short period. In this survey, we propose to categorize all existing circuit foundation models into two primary types: 1) encoder-based methods performing general circuit representation learning for predictive tasks; and 2) decoder-based methods leveraging large language models (LLMs) for generative tasks. For our introduced works, we cover their input modalities, model architecture, pre-training strategies, domain adaptation techniques, and downstream design applications. In addition, this paper discussed the unique properties of circuits from the data perspective. These circuit properties have motivated many works in this domain and differentiated them from general AI techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。