arXiv:2608.28669cs.CVcs.PL2026-08

从图像或描述生成可执行的3D建模代码,关键在构建路径的显式表达。

MIRAGE-CAD: Construction-Mediated Multimodal Generation of Executable CAD Programs

  • 用统一构建路径表示融合多模态输入,生成可执行的参数化建模程序。
  • 在四种输入下建模成功率55.4%~70.0%,步骤导出成功率52.3%~66.2%。
  • 显式构建计划提升可读性与可测性,适合需精确控制的工业设计场景。

从观测物体恢复可执行的参数化CAD程序本质上存在歧义,因为相同的最终几何形状可能由不同的构造过程产生。本文研究了四种输入类型:自然语言描述、渲染图像、点云以及STEP/B-Rep几何数据。MIRAGE-CAD将每种输入映射到共享的构造表示,并通过显式的构造计划接口实现程序生成。生成的Python CAD代码由OpenCASCADE内核执行以构建实体并导出为STEP格式。在每种模态的2,500个保留查询上,系统在推理时无需检索即达到55.4%-70.0%的建模成功和52.3%-66.2%的步骤导出成功率。受控对比表明,高质量重建不依赖于将构造表示以文本形式表达:直接基于连续表示的解码器同样能实现强重建效果;而暴露匹配的基于计划的解码器在单个部件的几何保真度上未检测到材料损失。显式构造计划提供了一个可读且独立可测量的中间表示,其与参考构造的一致性对下游执行成功率具有指导意义。最后,我们证明可执行性、几何保真度和参数响应性可能显著偏离,应分别评估。

原文摘要 · Abstract (English)

Recovering an executable parametric CAD program from an observed object is fundamentally ambiguous, because the same final geometry can result from different construction procedures. We study this problem from four types of input: natural-language descriptions, rendered images, point clouds, and STEP/B-Rep geometry. MIRAGE-CAD maps each input to a shared construction representation and mediates program generation through an explicit construction-plan interface. The resulting Python CAD code is executed by an OpenCASCADE kernel to build the solid and export it as STEP. On 2,500 held-out queries per modality, the system achieves 55.4-70.0% build success and 52.3-66.2% STEP export success without retrieval at inference. Controlled comparisons show that strong reconstruction does not depend on expressing the construction representation as text: a decoder conditioned directly on the continuous representation also reconstructs strongly, while an exposure-matched plan-based decoder shows no detected material loss in per-part geometric fidelity. The explicit plan instead provides a readable and separately measurable intermediate representation whose agreement with the reference construction is informative about downstream execution success. Finally, we show that executable validity, geometric fidelity, and parametric responsiveness can diverge substantially and should therefore be evaluated separately.

CAD生成多模态可执行代码参数化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。