arXiv:2607.29283cs.ARcs.LG2026-07

用少量验证数据高效筛选出更适合训练RTL生成模型的代码数据。

RTLCurator: Label-Efficient Data Curation for RTL Generation

论文配图:RTLCurator: Label-Efficient Data Curation for RTL Generation
图 1 · 摘自论文原文
  • 通过对比失败实现学习行为感知的兼容性先验,智能筛选数据。
  • 保留80%数据训练效果优于全量数据,仅需验证10%样本。
  • 适合资源有限但需高质量硬件代码生成的团队使用。

训练大语言模型生成寄存器传输级(RTL)代码需要大量规格与代码配对数据,但真实数据稀缺,多数公开数据集为合成生成。合成数据虽规模大,但正确率低:两个常用数据集中仅24.4%和53.5%的配对通过功能测试。仅按正确性筛选会导致保留的数据过于简单短小,且验证成本高。本文提出RTLCurator,通过对比规格与仿真失败的实现,学习行为感知的兼容性先验,并用少量已验证对校准该先验。随后在对齐度、表征覆盖和结构丰富性间权衡,构建保留子集。在CodeV和RTLCoder上,仅验证10%数据即保留80%的训练集,性能优于全量训练;仅依赖评分排序或全部仿真过滤均表现更差。

原文摘要 · Abstract (English)

Training large language models (LLMs) to write register-transfer level (RTL) requires large corpora of paired specifications and code, and such data is scarce enough that most public corpora are now synthesized. Synthesis provides scale but not correctness, and in two widely used RTL datasets only 24.4% and 53.5% of pairs pass generated functional tests. This raises the question of how much of such a corpus to keep and which part of it. Correctness alone is a poor answer. A pair that misbehaves in one corner case still shows valid syntax and interface conventions, and complex sequential designs are both harder to generate and harder to validate, so filtering by correctness leaves a corpus of short and simple modules. Correctness is also hard to obtain, since behavior leaves little trace on the surface in RTL, and validating an entire corpus only sorts pairs into passed and failed. We present RTLCurator, which learns a behavior-aware compatibility prior by contrasting each specification with implementations that fail simulation, and calibrates it to a new corpus using a small number of validated pairs. It then constructs the retained subset by balancing alignment, representation coverage, and RTL structural richness. On CodeV and RTLCoder, keeping 80% of the corpus this way improves on training with the full corpus across all reported metrics while validating only 10% of the pool, whereas ranking by the score alone falls below random selection and filtering the whole pool by simulation does no better.

RTL生成数据筛选大模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。