arXiv:2602.22609cs.ARcs.LG2026-02中稿 · TACAS 2026

用强化学习生成小而难的硬件验证测试用例,揭露现有工具弱点。

EvolveGen: Algorithmic Level Hardware Model Checking Benchmark Generation through Reinforcement Learning

  • RL代理在算法层构建计算图,通过综合生成结构不同但功能相同的电路
  • 自动生成的小规模难题使主流验证器运行时间显著延长,暴露其性能瓶颈
  • 适合验证算法研究者和工具开发者,用于评估和改进模型检查器

硬件模型检查的进步依赖高质量基准测试集。然而,当前社区面临严重基准缺口:现有测试集数量有限,常仅以BTOR2等格式提供,缺乏原始寄存器传输级(RTL)设计,且偏向极端难度——样本要么过于简单,要么无法求解。这阻碍了新验证技术的严谨评估,也导致求解器启发式过度适配少数问题。为此,我们提出EvolveGen,一种结合强化学习(RL)与高层次综合(HLS)的硬件模型检查基准生成框架。该方法在算法层面抽象,由RL代理学习构建计算图;通过不同综合指令编译这些图,生成功能等价但结构各异的硬件设计,从而构造具有挑战性的模型检查实例。以求解器运行时间为奖励信号,代理可自主发现并生成小而难的实例,暴露出求解器特定弱点。实验表明,EvolveGen能高效生成多样化基准(如AIGER、BTOR2格式),有效揭示当前最先进模型检查器的性能瓶颈。

原文摘要 · Abstract (English)

Progress in hardware model checking depends critically on high-quality benchmarks. However, the community faces a significant benchmark gap: existing suites are limited in number, often distributed only in representations such as BTOR2 without access to the originating register-transfer-level (RTL) designs, and biased toward extreme difficulty where instances are either trivial or intractable. These limitations hinder rigorous evaluation of new verification techniques and encourage overfitting of solver heuristics to a narrow set of problems. To address this, we introduce EvolveGen, a framework for generating hardware model checking benchmarks by combining reinforcement learning (RL) with high-level synthesis (HLS). Our approach operates at an algorithmic level of abstraction in which an RL agent learns to construct computation graphs. By compiling these graphs under different synthesis directives, we produce pairs of functionally equivalent but structurally distinct hardware designs, inducing challenging model checking instances. Solver runtime is used as the reward signal, enabling the agent to autonomously discover and generate small-but-hard instances that expose solver-specific weaknesses. Experiments show that EvolveGen efficiently creates a diverse benchmark set in standard formats (e.g., AIGER and BTOR2) and effectively reveals performance bottlenecks in state-of-the-art model checkers.

硬件验证强化学习基准生成模型检查

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。