arXiv:2509.15246cs.GRcs.AI2025-09中稿 · and soon published…被引 10

用多模态对齐与合成数据平衡,让AI自动生成高精度3D CAD程序。

GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancing

  • 通过对比学习对齐CAD与几何编码器的潜在表示
  • 合成数据增强使复杂结构生成准确率显著提升
  • 适合逆向工程与自动化设计领域研究者使用

CAD程序是以参数化命令序列表示、可编译为精确3D几何体的关键工具,广泛用于高效工程设计。从点云、网格等非参数化数据自动生成此类程序仍是挑战性任务,通常需大量人工干预。现有深度生成模型受限于数据集不平衡且规模不足,尤其缺乏复杂CAD程序样本。为此,本文提出GenCAD-3D,一种基于对比学习对齐CAD与几何编码器潜在空间的多模态生成框架,并结合潜在扩散模型实现CAD序列生成与检索。此外,我们设计了专为数据集平衡与扩展的合成数据增强策略SynthBal,显著提升复杂几何结构的代表性。实验表明,SynthBal大幅提高重建准确率,减少无效CAD模型生成,在高复杂度几何体上性能超越现有基准。该成果对逆向工程与工程设计自动化具有重要意义。我们将公开发布数据集与代码,包含51个3D打印及激光扫描零件。

原文摘要 · Abstract (English)

CAD programs, structured as parametric sequences of commands that compile into precise 3D geometries, are fundamental to accurate and efficient engineering design processes. Generating these programs from nonparametric data such as point clouds and meshes remains a crucial yet challenging task, typically requiring extensive manual intervention. Current deep generative models aimed at automating CAD generation are significantly limited by imbalanced and insufficiently large datasets, particularly those lacking representation for complex CAD programs. To address this, we introduce GenCAD-3D, a multimodal generative framework utilizing contrastive learning for aligning latent embeddings between CAD and geometric encoders, combined with latent diffusion models for CAD sequence generation and retrieval. Additionally, we present SynthBal, a synthetic data augmentation strategy specifically designed to balance and expand datasets, notably enhancing representation of complex CAD geometries. Our experiments show that SynthBal significantly boosts reconstruction accuracy, reduces the generation of invalid CAD models, and markedly improves performance on high-complexity geometries, surpassing existing benchmarks. These advancements hold substantial implications for streamlining reverse engineering and enhancing automation in engineering design. We will publicly release our datasets and code, including a set of 51 3D-printed and laser-scanned parts on our project site.

CAD生成多模态学习合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。