arXiv:2504.20830cs.CV2025-04ICCV被引 7

提出首个基于B-Rep的多模态CAD生成框架,解决设计生成中的结构与拓扑难题。

CMT: A Cascade MAR with Topology Predictor for Multimodal Conditional CAD Generation

  • 采用级联MAR+拓扑预测器,捕捉边-面拓扑先验
  • 在ABC数据集上无条件生成覆盖率达+10.68%,有效性提升+10.3%
  • 适用于工业设计、智能制造领域多模态建模需求

尽管精确且用户友好的计算机辅助设计(CAD)对工业设计与制造至关重要,现有方法仍因表示过于简化或架构无法支持多模态设计需求而表现不足。本文从方法与数据两方面入手,提出首个基于边界表示(B-Rep)的多模态CAD生成框架——级联MAR与拓扑预测器(CMT)。该框架通过级联MAR有效捕捉B-Rep中“边-计数-面”的先验关系,同时拓扑预测器直接从MAR的紧凑标记中估计B-Rep拓扑结构。为支持大规模训练,构建了包含超过130万条B-Rep模型的多模态数据集mmABC,涵盖点云、文本描述与多视角图像。大量实验表明,CMT在条件与非条件生成任务中均表现优越:在非条件生成任务中,相比最先进方法,覆盖率达+10.68%,有效性提升+10.3%;在图像条件生成任务中,于mmABC数据集上改善4.01的Chamfer距离。

原文摘要 · Abstract (English)

While accurate and user-friendly Computer-Aided Design (CAD) is crucial for industrial design and manufacturing, existing methods still struggle to achieve this due to their over-simplified representations or architectures incapable of supporting multimodal design requirements. In this paper, we attempt to tackle this problem from both methods and datasets aspects. First, we propose a cascade MAR with topology predictor (CMT), the first multimodal framework for CAD generation based on Boundary Representation (B-Rep). Specifically, the cascade MAR can effectively capture the ``edge-counters-surface'' priors that are essential in B-Reps, while the topology predictor directly estimates topology in B-Reps from the compact tokens in MAR. Second, to facilitate large-scale training, we develop a large-scale multimodal CAD dataset, mmABC, which includes over 1.3 million B-Rep models with multimodal annotations, including point clouds, text descriptions, and multi-view images. Extensive experiments show the superior of CMT in both conditional and unconditional CAD generation tasks. For example, we improve Coverage and Valid ratio by +10.68% and +10.3%, respectively, compared to state-of-the-art methods on ABC in unconditional generation. CMT also improves +4.01 Chamfer on image conditioned CAD generation on mmABC.

CAD生成多模态B-Rep拓扑预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。