9000张机械结构图+描述，助力AI生成设计
A Dataset for Mechanical Mechanisms
- 构建含2D/3D草图的9000张机械结构图像数据集
- 用Stable Diffusion生成3D结构效果较好，2D生成不稳定
- 适合机械设计与AI生成研究者参考
本研究引入一个包含约9000张机械结构图像及其对应描述的数据集，旨在支持机构设计领域的研究。数据集涵盖多样化的2D和3D草图，经过精心筛选以确保相关性与质量。我们通过微调两个模型展示了该数据集的应用：1）Stable Diffusion（用于生成新机械设计），2）BLIP-2（用于为设计生成描述）。尽管Stable Diffusion在生成连贯的3D草图方面表现出色，但在处理2D草图时存在困难，且偶尔产生无意义输出。这些局限性凸显了进一步发展的必要性，尤其是扩充数据集和优化模型架构。本工作为利用生成式AI推动机械设计迈出了重要一步，同时揭示了当前方法的潜力与不足。
原文摘要 · Abstract (English)
This study introduces a dataset consisting of approximately 9,000 images of mechanical mechanisms and their corresponding descriptions, aimed at supporting research in mechanism design. The dataset consists of a diverse collection of 2D and 3D sketches, meticulously curated to ensure relevance and quality. We demonstrate the application of this dataset by fine-tuning two models: 1) Stable Diffusion (for generating new mechanical designs), and 2) BLIP-2 (for captioning these designs). While the results from Stable Diffusion show promise, particularly in generating coherent 3D sketches, the model struggles with 2D sketches and occasionally produces nonsensical outputs. These limitations underscore the need for further development, particularly in expanding the dataset and refining model architectures. Nonetheless, this work serves as a step towards leveraging generative AI in mechanical design, highlighting both the potential and current limitations of these approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。