arXiv:2506.10337cs.CV2025-06NeurIPS被引 5

用大模型实现局部几何可控的CAD自动修改,精准匹配用户设计指令。

GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Models

  • 分步生成局部几何描述:简单部分用顶点标注,复杂部分用视觉语言模型标注。
  • 在22.1万局部部件上训练,实现高保真、符合文本指令的结构重建。
  • 适合需要快速修改或生成特定几何形状的工业设计与工程人员使用。

局部几何可控的计算机辅助设计(CAD)生成旨在自动修改CAD模型的局部区域,提升设计效率,并确保新生成局部区域的形状符合用户的几何指令(如等腰直角三角形或一角被切掉的矩形)。然而现有方法难以兼顾文本指令遵循与局部聚焦能力。为此,本文提出GeoCAD,一种用户友好且局部几何可控的CAD生成方法。首先提出互补式标注策略:对简单局部采用基于顶点的标注,对复杂局部采用基于视觉大语言模型(VLLM)的标注,共生成约22.1万个不同局部部件的几何描述。训练阶段,随机遮蔽一个局部部件,以剩余部分和其几何指令为输入,通过大语言模型(LLMs)预测缺失部分。推理时,用户可指定任意局部区域进行修改,并遵循多种预设几何指令。大量实验表明,GeoCAD在生成质量、有效性及文本到CAD一致性方面表现优异。代码将公开于https://github.com/Zhanwei-Z/GeoCAD。

原文摘要 · Abstract (English)

Local geometry-controllable computer-aided design (CAD) generation aims to modify local parts of CAD models automatically, enhancing design efficiency. It also ensures that the shapes of newly generated local parts follow user-specific geometric instructions (e.g., an isosceles right triangle or a rectangle with one corner cut off). However, existing methods encounter challenges in achieving this goal. Specifically, they either lack the ability to follow textual instructions or are unable to focus on the local parts. To address this limitation, we introduce GeoCAD, a user-friendly and local geometry-controllable CAD generation method. Specifically, we first propose a complementary captioning strategy to generate geometric instructions for local parts. This strategy involves vertex-based and VLLM-based captioning for systematically annotating simple and complex parts, respectively. In this way, we caption $\sim$221k different local parts in total. In the training stage, given a CAD model, we randomly mask a local part. Then, using its geometric instruction and the remaining parts as input, we prompt large language models (LLMs) to predict the masked part. During inference, users can specify any local part for modification while adhering to a variety of predefined geometric instructions. Extensive experiments demonstrate the effectiveness of GeoCAD in generation quality, validity and text-to-CAD consistency. Code will be available at https://github.com/Zhanwei-Z/GeoCAD.

CAD生成大模型几何控制设计自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。