用AI自动生成真实硬件漏洞,效率超人工五倍
BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesis
- 多智能体协作生成、插入并验证RTL级功能漏洞
- 每小时产出17.7个有效漏洞,准确率达94%
- 适合芯片验证与ML调试研究者使用
硬件复杂度持续增加,验证资源面临压力,促使采用机器学习提升调试效率。然而,现有方法难以可靠生成多样且可扩展的漏洞数据集。本文提出BugGen,首个完全自主的多智能体大模型流水线,利用大语言模型系统性生成、插入并验证RTL中的真实功能漏洞。该方法通过模块拆分、闭环智能体架构选择变异目标,并结合迭代修正与回滚机制,确保语法正确性和功能可检测性。在五个OpenTitan IP模块上评估,共生成500个唯一漏洞,功能准确率94%,每小时产出17.7个经验证漏洞,效率超过人工专家五倍。此外,还发现OpenTitan回归测试中104个此前未察觉的漏洞,揭示了验证覆盖率盲区。相比Certitude,BugGen在语法准确性上提升一倍以上,更深入暴露测试平台盲点,生成的漏洞更具功能意义和复杂性。当使用其生成的数据训练基于ML的故障归因模型时,在不同IP模块上实现88.1%–93.2%的分类准确率,证实了生成漏洞的真实性和实用性。因此,BugGen为高质量漏洞数据集生成提供了可扩展解决方案,显著提升验证效率与机器学习辅助调试能力。
原文摘要 · Abstract (English)
Hardware complexity continues to strain verification resources, motivating the adoption of machine learning (ML) methods to improve debug efficiency. However, ML-assisted debugging critically depends on diverse and scalable bug datasets, which existing manual or automated bug insertion methods fail to reliably produce. We introduce BugGen, a first of its kind, fully autonomous, multi-agent pipeline leveraging Large Language Models (LLMs) to systematically generate, insert, and validate realistic functional bugs in RTL. BugGen partitions modules, selects mutation targets via a closed-loop agentic architecture, and employs iterative refinement and rollback mechanisms to ensure syntactic correctness and functional detectability. Evaluated across five OpenTitan IP blocks, BugGen produced 500 unique bugs with 94% functional accuracy and achieved a throughput of 17.7 validated bugs per hour-over five times faster than typical manual expert insertion. Additionally, BugGen identified 104 previously undetected bugs in OpenTitan regressions, highlighting its utility in exposing verification coverage gaps. Compared against Certitude, BugGen demonstrated over twice the syntactic accuracy, deeper exposure of testbench blind spots, and more functionally meaningful and complex bug scenarios. Furthermore, when these BugGen-generated datasets were employed to train ML-based failure triage models, we achieved high classification accuracy (88.1%-93.2%) across different IP blocks, confirming the practical utility and realism of generated bugs. BugGen thus provides a scalable solution for generating high-quality bug datasets, significantly enhancing verification efficiency and ML-assisted debugging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。