arXiv:2505.17702cs.CVcs.AI2025-05中稿 · ICLR被引 28

用开源模型本地生成3D参数化CAD,通过视觉与思维链反馈自优化。

Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek

  • 用DeepSeek-R1生成初版CAD,结合视觉和思维链反馈迭代优化。
  • 在多个指标上验证有效,生成的模型符合工业需求。
  • 首个本地部署开源模型做CAD生成的研究,适合工业设计场景。

计算机辅助设计(CAD)生成建模将深刻改变工业产品设计。近期研究已拓展至大语言模型(LLM)领域。与微调方法相比,无需训练的方法通常利用先进的闭源大模型,提升开发AI生成参数化CAD模型的灵活性与效率。然而,顶级闭源模型本地部署成本高、限制多,制约实际应用。本文首次探索使用本地部署的开源推理模型DeepSeek-R1,基于无训练方法生成3D参数化CAD模型。这是首个在自精炼机制中同时引入视觉反馈与思维链(CoT)反馈的研究。具体而言,初始生成的参数化CAD模型被渲染为一系列分步视角图像,由视觉语言模型(VLM)与DeepSeek-R1生成的对应思维链共同评估;评估结果用于指导DeepSeek-R1对初始模型进行下一轮生成优化。此外,我们提出一种基于SSR(草图、基于草图特征、优化)三元设计范式的新型3D CAD数据集,涵盖广泛CAD命令,有效匹配工业应用需求,适用于大模型生成任务。大量实验验证了Seek-CAD在多种指标下的有效性。

原文摘要 · Abstract (English)

The advent of Computer-Aided Design (CAD) generative modeling will significantly transform the design of industrial products. The recent research endeavor has extended into the realm of Large Language Models (LLMs). In contrast to fine-tuning methods, training-free approaches typically utilize the advanced closed-source LLMs, thereby offering enhanced flexibility and efficiency in the development of AI agents for generating CAD parametric models. However, the substantial cost and limitations of local deployment of the top-tier closed-source LLMs pose challenges in practical applications. The Seek-CAD is the pioneer exploration of locally deployed open-source inference LLM DeepSeek-R1 for CAD parametric model generation with a training-free methodology. This study is the first investigation to incorporate both visual and Chain-of-Thought (CoT) feedback within the self-refinement mechanism for generating CAD models. Specifically, the initial generated parametric CAD model is rendered into a sequence of step-wise perspective images, which are subsequently processed by a Vision Language Model (VLM) alongside the corresponding CoTs derived from DeepSeek-R1 to assess the CAD model generation. Then, the feedback is utilized by DeepSeek-R1 to refine the initial generated model for the next round of generation. Moreover, we present an innovative 3D CAD model dataset structured around the SSR (Sketch, Sketch-based feature, and Refinements) triple design paradigm. This dataset encompasses a wide range of CAD commands, thereby aligning effectively with industrial application requirements and proving suitable for the generation of LLMs. Extensive experiments validate the effectiveness of Seek-CAD under various metrics.

3D生成CAD建模自精炼开源模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。