用代码生成3D机械零件，比传统网格更精确可调
Don't Mesh with Me: Generating Constructive Solid Geometry Instead of Meshes by Fine-Tuning a Code-Generation LLM
- 用代码替代网格表示3D零件，基于构造实体几何（CSG）
- 通过微调代码生成大模型，能根据描述自动生成合理结构
- 适合需要高精度与可编辑性的机械设计人员使用
尽管大型语言模型（LLM）正在革新软件开发与创意产业，但在机械零件设计领域影响甚微，仍以人工为主。现有3D几何生成方法多采用网格表示，虽适用于游戏或动画资产，但缺乏机械工程所需的精度与灵活性。本文提出一种新方法：利用代码生成型大模型生成基于表面的构造实体几何（CSG）。首先，将边界表示几何（BREP）转换为基于CSG的Python脚本，构建数据集；其次，使用GPT-4生成自然语言标注。该数据集用于微调代码生成型大模型，使其可根据位置输入和自然语言描述，以合理方式完成几何结构，展现出几何理解能力。
原文摘要 · Abstract (English)
While recent advancements in machine learning, such as LLMs, are revolutionizing software development and creative industries, they have had minimal impact on engineers designing mechanical parts, which remains largely a manual process. Existing approaches to generating 3D geometry most commonly use meshes as a 3D representation. While meshes are suitable for assets in video games or animations, they lack sufficient precision and adaptability for mechanical engineering purposes. This paper introduces a novel approach for the generation of 3D geometry that generates surface-based Constructive Solid Geometry (CSG) by leveraging a code-generation LLM. First, we create a dataset of 3D mechanical parts represented as code scripts by converting Boundary Representation geometry (BREP) into CSG-based Python scripts. Second, we create annotations in natural language using GPT-4. The resulting dataset is used to fine-tune a code-generation LLM. The fine-tuned LLM can complete geometries based on positional input and natural language in a plausible way, demonstrating geometric understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。