arXiv:2605.12857cs.MAcs.AI2026-05

ChipMATE用多智能体协作生成更可靠的硬件代码,无需依赖外部测试基准。

ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation

论文配图:ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation
图 1 · 摘自论文原文
  • 构建Verilog与Python双智能体,互相验证输出,避免依赖黄金测试基准
  • 在4B和9B模型上达成75.0%和80.1%的通过率,超越现有自训练模型
  • 适合芯片设计团队使用,尤其适用于离线安全环境下的代码生成

现有的基于API的智能体系统在硬件寄存器传输级(RTL)代码生成中与工业实践严重脱节:它们假设生成时可访问黄金测试基准,依赖无法兼容芯片厂商隔离安全要求的闭源API,且无法在厂商私有RTL代码库上训练,导致内部数据浪费。近期自训练模型虽解决了部署问题,但仍是单轮生成器,忽视验证在真实工业流程中的关键作用。为此,我们提出ChipMATE,首个自训练的多智能体框架用于RTL生成。受工业实践中模块间独立编写并相互校验的启发,ChipMATE将Verilog智能体与Python参考模型智能体配对,彼此验证输出结果,无需任何黄金参考。我们设计了基于回溯的推理流程以防止错误传播,并采用两阶段训练策略:先分别训练各智能体以饱和其生成能力,再联合训练以提升协作效率。为支持训练,我们构建了混合数据生成框架,产出64.4K条高质量参考模型样本。ChipMATE在VerilogEval V2上,4B和9B基模型的pass@1分别达到75.0%和80.1%,超越所有现有自训练模型,甚至优于1600B参数的DeepSeek V4。代码与模型权重已公开于https://github.com/zhongkaiyu/ChipMATE。

原文摘要 · Abstract (English)

Existing API-based agentic systems for RTL code generation are fundamentally misaligned with industrial practice: they assume a golden testbench is available at generation time, rely on closed-source APIs incompatible with chip vendors' air-gapped security requirements, and cannot be trained on vendors' proprietary RTL codebases, leaving valuable internal data unused. Recent self-trained models address the deployment constraint but remain single-turn generators that overlook the critical role of verification in real industrial flows. To bridge these gaps, we present ChipMATE, the first self-trained multi-agent framework for RTL generation. Inspired by industrial practice where correctness emerges from cross-comparison between independently written RTL modules and reference models, ChipMATE pairs a Verilog agent with a Python reference-model agent that mutually verify each other's outputs without any golden oracle. We design a backtrack-based inference workflow to prevent error propagation across turns, and a two-stage training pipeline that first trains each agent individually to saturate its code-generation capability, then trains the team jointly to collaborate effectively. To support the training, we further build a hybrid data-generation framework that produces 64.4K high-quality reference model training samples. ChipMATE achieves 75.0\% and 80.1\% pass@1 on VerilogEval V2 with 4B and 9B base models, outperforming all existing self-trained models and even DeepSeek V4 with 1600B parameters. Our code and model weights are publicly available in https://github.com/zhongkaiyu/ChipMATE.

芯片设计多智能体代码生成自训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。