用图像生成可编辑的3D CAD模型,提升设计效率。
GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priors
- 结合对比学习与扩散模型,将图像转为参数化CAD指令序列。
- 在无条件与有条件生成上均显著优于现有方法。
- 支持以图搜图检索大型CAD数据库,适合工业设计场景。
通过计算机辅助设计(CAD)创建可制造且可编辑的3D形状仍高度依赖人工,受限于3D实体边界表示的复杂拓扑结构及不直观的设计工具。尽管多数3D形状生成研究聚焦于网格、体素或点云等表示方式,但实际工程应用需要具备可修改性、可制造性以及多模态条件下的CAD模型生成能力。本文提出GenCAD,一种基于自回归变压器与对比学习框架,并融合潜在扩散模型的生成模型,可将图像输入转换为参数化CAD命令序列,生成可编辑的3D形状表示。大量评估表明,GenCAD在无条件与有条件生成方面均显著优于当前最先进的方法。此外,其对比学习框架实现了通过图像查询从大型CAD数据库中检索模型的能力,这是CAD领域的一项关键挑战。结果表明,生成模型有望显著加速从设计到生产的全流程,并实现不同设计模态的无缝集成。
原文摘要 · Abstract (English)
The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design tools. While most work in the 3D shape generation literature focuses on representations like meshes, voxels, or point clouds, practical engineering applications demand the modifiability and manufacturability of CAD models and the ability for multi-modal conditional CAD model generation. This paper introduces GenCAD, a generative model that employs autoregressive transformers with a contrastive learning framework and latent diffusion models to transform image inputs into parametric CAD command sequences, resulting in editable 3D shape representations. Extensive evaluations demonstrate that GenCAD significantly outperforms existing state-of-the-art methods in terms of the unconditional and conditional generations of CAD models. Additionally, the contrastive learning framework of GenCAD facilitates the retrieval of CAD models using image queries from large CAD databases, which is a critical challenge within the CAD community. Our results provide a significant step forward in highlighting the potential of generative models to expedite the entire design-to-production pipeline and seamlessly integrate different design modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。