arXiv:2505.14646cs.CVcs.AI2025-05被引 49

用视觉生成可编辑的3D CAD代码,让设计更高效。

CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation

论文配图:CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation
图 1 · 摘自论文原文
  • 基于图像直接生成可运行的CadQuery代码
  • 语法正确率100%,3D模型相似度领先现有模型
  • 能处理真实照片并泛化到未见过的操作

高效创建准确且可编辑的3D CAD模型对工程设计至关重要,直接影响产品创新的成本与上市时间。当前手动流程耗时长且依赖高阶用户技能。尽管人工智能驱动的CAD生成已有进展,但现有模型受限于对CAD操作表示不完整、无法泛化至真实图像、输出准确率低等问题。本文提出CAD-Coder,一个开源视觉语言模型(VLM),专门微调用于从视觉输入直接生成可编辑的CadQuery Python代码。基于自建数据集GenCAD-Code(含163,000对CAD模型图像与代码),CAD-Coder在语法正确性上达到100%,3D实体相似度超越GPT-4.5和Qwen2.5-VL-72B等先进VLM基线。尤为关键的是,该模型展现出一定泛化能力,可成功从真实世界图像生成代码,并执行微调阶段未见的CAD操作。CAD-Coder性能与适应性凸显了针对代码微调的VLM在优化工程师工作流方面的潜力。项目已开源:https://github.com/anniedoris/CAD-Coder。

原文摘要 · Abstract (English)

Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive user expertise. While recent developments in AI-driven CAD generation show promise, existing models are limited by incomplete representations of CAD operations, inability to generalize to real-world images, and low output accuracy. This paper introduces CAD-Coder, an open-source Vision-Language Model (VLM) explicitly fine-tuned to generate editable CAD code (CadQuery Python) directly from visual input. Leveraging a novel dataset that we created--GenCAD-Code, consisting of over 163k CAD-model image and code pairs--CAD-Coder outperforms state-of-the-art VLM baselines such as GPT-4.5 and Qwen2.5-VL-72B, achieving a 100% valid syntax rate and the highest accuracy in 3D solid similarity. Notably, our VLM demonstrates some signs of generalizability, successfully generating CAD code from real-world images and executing CAD operations unseen during fine-tuning. The performance and adaptability of CAD-Coder highlights the potential of VLMs fine-tuned on code to streamline CAD workflows for engineers and designers. CAD-Coder is publicly available at: https://github.com/anniedoris/CAD-Coder.

CAD生成视觉语言模型代码生成开源工具

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。