arXiv:2512.06328cs.CV2025-12AAAI被引 10

用强化学习让大模型自动生成精准可编辑的参数化设计图

ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Models

  • 用视觉语言模型+强化学习,从简单输入生成复杂设计操作
  • 图像转CAD时平均切比雪夫距离降低至29.61(分布内)和80.23(分布外)
  • 支持可编辑、可组合的设计生成,适合工业设计自动化场景

我们提出ReCAD,一种基于强化学习的框架,通过利用预训练大模型(PLMs)的生成能力,从多模态输入中自动生成精确的参数化计算机辅助设计(CAD)模型。仅需点坐标等简单功能接口,即可实现模式复制、镜像等复杂操作,突破了以往方法依赖监督微调、可编辑性差、未能充分挖掘大模型生成先验的局限。具体而言,先对视觉语言模型(VLMs)进行微调,将CAD脚本重写为参数化代码,以生成用于监督的准确文本描述;随后提出新型强化学习策略,以参数化代码为引导,提升模型对复杂问题的推理能力;此外,采用分层基础构件学习过程,在统一奖励函数下逐步传授结构化与组合式技能,兼顾几何精度与语义一致性。ReCAD在文本到CAD和图像到CAD任务上均达到新最优,显著提升分布内与分布外的几何精度。例如,在图像到CAD任务中,平均切比雪夫距离从73.47降至29.61(分布内),从272.06降至80.23(分布外),大幅超越现有基线。

原文摘要 · Abstract (English)

We present ReCAD, a reinforcement learning (RL) framework that bootstraps pretrained large models (PLMs) to generate precise parametric computer-aided design (CAD) models from multimodal inputs by leveraging their inherent generative capabilities. With just access to simple functional interfaces (e.g., point coordinates), our approach enables the emergence of complex CAD operations (e.g., pattern replication and mirror). This stands in contrast to previous methods, which typically rely on knowledge injected through supervised fine-tuning (SFT), offer limited support for editability, and fail to exploit the strong generative priors of PLMs. Specifically, the ReCAD framework begins by fine-tuning vision-language models (VLMs) to equip them with basic CAD model generation capabilities, where we rewrite CAD scripts into parameterized code that is leveraged to generate accurate textual descriptions for supervision. Then, we propose a novel RL strategy that incorporates parameterized code as guidance to enhance the model's reasoning on challenging questions. Furthermore, we employ a hierarchical primitive learning process to progressively teach structured and compositional skills under a unified reward function that ensures both geometric accuracy and semantic fidelity. ReCAD sets a new state-of-the-art in both text-to-CAD and image-to-CAD tasks, significantly improving geometric accuracy across in-distribution and out-of-distribution settings. In the image-to-CAD task, for instance, it reduces the mean Chamfer Distance from 73.47 to 29.61 (in-distribution) and from 272.06 to 80.23 (out-of-distribution), outperforming existing baselines by a substantial margin.

CAD生成强化学习多模态参数化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。