用指针选体面,让大模型生成更准的复杂零件。
Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection
- 用指针选择几何体,把实体信息显式融入命令序列
- 生成复杂结构时误差极低,比之前方法提升明显
- 适合需要精准建模的工业设计与自动化工程场景
CAD建模耗时费力但至关重要。现有基于大语言模型(LLM)的方法将CAD表示为命令序列,但在实际中受限于无法选择具体几何实体(如面或边),难以支持倒角、圆角等复杂操作。此外,草图和拉伸等连续操作的离散化会导致拓扑错误。为此,我们提出Pointer-CAD,一种基于指针的新型LLM驱动CAD生成框架,通过在命令序列中引入对几何体的显式指针选择,将边界表示(B-rep)信息融入序列建模。该框架将建模过程分解为步骤,每一步生成均依赖于文本描述及前序步骤生成的B-rep。当操作需选择特定几何实体时,模型预测一个指针,从候选集中选出最一致的特征对象。此机制同时降低了命令序列表示中的量化误差。为训练该模型,我们构建了约57.5万条专家级自然语言描述的标注数据集。大量实验表明,Pointer-CAD能有效生成复杂几何结构,显著降低分割误差,相比先前方法大幅减少由量化误差引发的拓扑不准确问题。
原文摘要 · Abstract (English)
Constructing computer-aided design (CAD) models is labor-intensive but essential for engineering and manufacturing. Recent advances in Large Language Models (LLMs) have inspired the LLM-based CAD generation by representing CAD as command sequences. But these methods struggle in practical scenarios because command sequence representation does not support entity selection (e.g. faces or edges), limiting its ability to support complex editing operations such as chamfer or fillet. Further, the discretization of a continuous variable during sketch and extrude operations may result in topological errors. To address these limitations, we present Pointer-CAD, a novel LLM-based CAD generation framework that leverages a pointer-based command sequence representation to explicitly incorporate the geometric information of B-rep models into sequential modeling. In particular, Pointer-CAD decomposes CAD model generation into steps, conditioning the generation of each subsequent step on both the textual description and the B-rep generated from previous steps. Whenever an operation requires the selection of a specific geometric entity, the LLM predicts a Pointer that selects the most feature-consistent candidate from the available set. Such a selection operation also reduces the quantization error in the command sequence-based representation. To support the training of Pointer-CAD, we develop a data annotation pipeline that produces expert-level natural language descriptions and apply it to build a dataset of approximately 575K CAD models. Extensive experimental results demonstrate that Pointer-CAD effectively supports the generation of complex geometric structures and reduces segmentation error to an extremely low level, achieving a significant improvement over prior command sequence methods, thereby significantly mitigating the topological inaccuracies introduced by quantization error.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。