arXiv:2602.12402cs.LGcs.AI2026-02被引 1

用强化学习自动设计模拟电路,生成结果100%结构正确。

AstRL: Analog and Mixed-Signal Circuit Synthesis with Deep Reinforcement Learning

  • 将电路设计建模为图生成问题,通过强化学习直接优化目标。
  • 在三个真实任务中,生成电路100%结构正确,90%以上功能达标。
  • 适合芯片设计自动化、AI辅助电路设计的研究者与工程师。

模拟与混合信号(AMS)集成电路是现代计算与通信系统的核心。然而,随着设计复杂度持续上升,AMS自动化的进展仍十分有限,这源于缺乏适用于多样化电路设计空间的通用优化方法,而这些空间往往差异大、约束多且不可微。为此,本文将电路设计视为图生成问题,提出基于深度强化学习的新型合成方法AstRL。该方法采用策略梯度算法,在嵌入仿真器的环境中生成电路,并通过真实反馈训练。结合行为克隆和判别器相似性奖励,首次实现专家对齐的通用电路生成范式。方法在晶体管级别操作,支持高表达力的细粒度拓扑生成;动作空间与环境中的强归纳偏置确保生成结构一致且有效。三个真实设计任务的实验表明,相比现有最优基线,各项指标显著提升,100%生成电路结构正确,超90%具备所需功能。

原文摘要 · Abstract (English)

Analog and mixed-signal (AMS) integrated circuits (ICs) lie at the core of modern computing and communications systems. However, despite the continued rise in design complexity, advances in AMS automation remain limited. This reflects the central challenge in developing a generalized optimization method applicable across diverse circuit design spaces, many of which are distinct, constrained, and non-differentiable. To address this, our work casts circuit design as a graph generation problem and introduces a novel method of AMS synthesis driven by deep reinforcement learning (AstRL). Based on a policy-gradient approach, AstRL generates circuits directly optimized for user-specified targets within a simulator-embedded environment that provides ground-truth feedback during training. Through behavioral-cloning and discriminator-based similarity rewards, our method demonstrates, for the first time, an expert-aligned paradigm for generalized circuit generation validated in simulation. Importantly, the proposed approach operates at the level of individual transistors, enabling highly expressive, fine-grained topology generation. Strong inductive biases encoded in the action space and environment further drive structurally consistent and valid generation. Experimental results for three realistic design tasks illustrate substantial improvements in conventional design metrics over state-of-the-art baselines, with 100% of generated designs being structurally correct and over 90% demonstrating required functionality.

电路设计强化学习AI生成芯片自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。