用强化学习训练大模型,让文字生成三维设计更智能高效。
TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning

- 将大模型作为会用工具的智能体,结合强化学习优化设计流程。
- 在自研交互式建模环境中实现端到端训练,提升建模准确率。
- 适合想开发自主设计系统的开发者与工业设计师参考。
计算机辅助设计(CAD)是依赖长程推理与连贯建模动作的专家级任务。尽管大语言模型(LLMs)在语言智能体处理现实任务方面取得显著进展,但关于工具使用型LLM如何最优地与CAD引擎交互的研究仍属空白,阻碍了基于LLM的智能体式文本到CAD建模系统的发展。本文提出ToolCAD,一个新型代理式CAD框架,利用LLM作为工具使用型智能体完成文本到CAD的生成。我们构建了一个交互式CAD建模训练环境,用于展开推理与工具增强的交互轨迹,并融合混合反馈与人工监督。同时,提出一种端到端后训练策略,通过在线课程强化学习,使LLM智能体逐步生成精细化的CAD建模思维链(CAD-CoT),成长为熟练的工具使用型智能体。实验表明,ToolCAD填补了开源LLM用于CAD工具使用智能体的训练与应用空白,使其性能可媲美专有模型,为更开放、鲁棒的自主文本到CAD建模系统铺平道路。
原文摘要 · Abstract (English)
Computer-Aided Design (CAD) is an expert-level task that relies on long-horizon reasoning and coherent modeling actions. Large Language Models (LLMs) have shown remarkable advancements in enabling language agents to tackle real-world tasks. Notably, there has been no investigation into how tool-using LLMs optimally interact with CAD engines, hindering the emergence of LLM-based agentic text-to-CAD modeling systems. We propose ToolCAD, a novel agentic CAD framework deploying LLMs as tool-using agents for text-to-CAD generation. Furthermore, we introduce an interactive CAD modeling gym to rollout reasoning and tool-augmented interaction trajectories with the CAD engine, incorporating hybrid feedback and human supervision. Meanwhile, an end-to-end post-training strategy is presented to enable the LLM agent to elicit refined CAD Modeling Chain of Thought (CAD-CoT) and evolve into proficient CAD tool-using agents via online curriculum reinforcement learning. Our findings demonstrate ToolCAD fills the gap in adopting and training open-source LLMs for CAD tool-using agents, enabling them to perform comparably to proprietary models, paving the way for more accessible and robust autonomous text-to-CAD modeling systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。