arXiv:2508.10118cs.LGcs.CV2025-08AAAI被引 12

用强化学习把设计意图精准转为可执行的3D建模代码

From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation

  • 通过思维链引导的强化学习,分步推理生成代码
  • 在真实数据集上代码可执行率提升至92.3%,几何精度提高18%
  • 适合需要高精度自动化建模的工程师和研发人员

计算机辅助设计(CAD)在工程制造中至关重要,但现有流程依赖大量专业知识与手工建模。大语言模型使自然语言生成代码成为可能,但将设计意图准确转化为可执行的参数化3D建模代码仍具挑战,需兼顾逻辑推理、语法正确性与数值精度。本文提出CAD-RL,一种多模态思维链(CoT)引导的强化学习后训练框架。方法结合基于思维链的冷启动与目标驱动的强化学习,采用三类任务特定奖励:可执行性奖励、几何精度奖励和外部评估奖励。为应对稀疏且高方差的奖励信号,引入三项优化策略:信任区域扩展以增强探索,精确标记损失提升尺寸参数准确性,过长过滤减少噪声监督。为支持训练与评测,发布ExeCAD数据集,包含16,540个真实世界CAD实例,含自然语言描述、结构化设计语言、可执行的CADQuery脚本及渲染3D模型。实验表明,CAD-RL在推理质量、输出精度与代码可执行性方面显著优于现有视觉语言模型。

原文摘要 · Abstract (English)

Computer-Aided Design (CAD) plays a vital role in engineering and manufacturing, yet current CAD workflows require extensive domain expertise and manual modeling effort. Recent advances in large language models (LLMs) have made it possible to generate code from natural language, opening new opportunities for automating parametric 3D modeling. However, directly translating human design intent into executable CAD code remains highly challenging, due to the need for logical reasoning, syntactic correctness, and numerical precision. In this work, we propose CAD-RL, a multimodal Chain-of-Thought (CoT) guided reinforcement learning post training framework for CAD modeling code generation. Our method combines CoT-based Cold Start with goal-driven reinforcement learning post training using three task-specific rewards: executability reward, geometric accuracy reward, and external evaluation reward. To ensure stable policy learning under sparse and high-variance reward conditions, we introduce three targeted optimization strategies: Trust Region Stretch for improved exploration, Precision Token Loss for enhanced dimensions parameter accuracy, and Overlong Filtering to reduce noisy supervision. To support training and benchmarking, we release ExeCAD, a noval dataset comprising 16,540 real-world CAD examples with paired natural language and structured design language descriptions, executable CADQuery scripts, and rendered 3D models. Experiments demonstrate that CAD-RL achieves significant improvements in reasoning quality, output precision, and code executability over existing VLMs.

CAD生成强化学习思维链代码生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。