用自然语言生成可制造的生物结构3D模型,效率高且可控。
Bioinspired123D: Generative 3D Modeling System for Bioinspired Structures
- 通过参数化代码直接生成3D结构,避免传统密集表示的高成本。
- 在4000+生物形态脚本上训练,性能比基础模型提升近4倍。
- 适合材料与结构设计领域的科研人员快速探索创新构型。
生成式AI在文本、图像和视频合成方面进展迅速,但科学设计中的文本到3D建模仍面临可控性差和计算成本高的挑战。现有3D生成方法多依赖网格、体素或点云,训练成本高且难以控制。我们提出Bioinspired123D,一种轻量级、模块化的代码即几何(code-as-geometry)生成系统,直接通过参数化程序生成可制造的3D结构。核心是Bioinspired3D,一个在4000多个生物及几何设计脚本上微调的小型语言模型,能将自然语言设计提示转化为编码平滑生物形态的Blender Python脚本。该数据集通过基于LLM和Blender的自动化质量控制流程扩展与验证。Bioinspired3D嵌入图式代理框架,结合多模态检索增强生成与视觉-语言模型批判器,实现脚本的迭代评估、批评与修复。我们在新基准上评估性能,结果显示Bioinspired123D相比未微调基线模型提升近4倍,且在参数量和算力远低于当前主流大模型的情况下仍显著超越其表现。通过优先采用代码即几何表示,该系统实现了高效、可控、可解释的文本到3D生成,降低了人工智能驱动材料与结构设计的门槛。
原文摘要 · Abstract (English)
Generative AI has made rapid progress in text, image, and video synthesis, yet text-to-3D modeling for scientific design remains particularly challenging due to limited controllability and high computational cost. Most existing 3D generative methods rely on meshes, voxels, or point clouds which can be costly to train and difficult to control. We introduce Bioinspired123D, a lightweight and modular code-as-geometry pipeline that generates fabricable 3D structures directly through parametric programs rather than dense visual representations. At the core of Bioinspired123D is Bioinspired3D, a compact language model finetuned to translate natural language design cues into Blender Python scripts encoding smooth, biologically inspired geometries. We curate a domain-specific dataset of over 4,000 bioinspired and geometric design scripts spanning helical, cellular, and tubular motifs with parametric variability. The dataset is expanded and validated through an automated LLM-driven, Blender-based quality control pipeline. Bioinspired3D is then embedded in a graph-based agentic framework that integrates multimodal retrieval-augmented generation and a vision-language model critic to iteratively evaluate, critique, and repair generated scripts. We evaluate performance on a new benchmark for 3D geometry script generation and show that Bioinspired123D demonstrates a near fourfold improvement over its non-finetuned base model, while also outperforming substantially larger state-of-the-art language models despite using far fewer parameters and compute. By prioritizing code-as-geometry representations, Bioinspired123D enables compute-efficient, controllable, and interpretable text-to-3D generation, lowering barriers to AI driven scientific discovery in materials and structural design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。