arXiv:2509.07010cs.CVcs.AI2025-09被引 3

用真人参与评估大模型生成的3D模型,提升设计准确性。

Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models

  • 引入人类反馈框架,量化评估3D模型几何与结构精度。
  • 代码级提示使生成模型在所有指标上实现完美重建。
  • 适合需要高精度3D设计的工业用户和研究者参考。

大型语言模型在理解多模态输入并生成复杂3D形状方面能力不断增强,但对几何与结构保真度的稳健评估方法仍不成熟。本文提出一种人机协同框架,用于定量评估大模型生成的3D模型,支持计算机辅助设计民主化、遗留设计逆向工程及快速原型开发。我们构建了一套综合性相似性与复杂度度量体系,包括体积分准确率、表面匹配度、尺寸保真度与拓扑复杂度,以基准测试生成模型与真实CAD参考之间的差异。以L型支架为例,系统比较了四种输入模态下的大模型表现:2D正交视图、等距草图、几何结构树及代码修正提示。结果表明,语义信息越丰富,生成保真度越高,代码级提示在所有指标上均实现完美重建。本工作关键贡献在于证明所提量化评估方法可显著加速逼近真实模型,远超仅依赖视觉观察与人工直觉的传统定性方法。该研究不仅深化了对人工智能辅助形状生成的理解,还为多样化的CAD应用提供了可扩展的验证与优化方法。

原文摘要 · Abstract (English)

Large Language Models are increasingly capable of interpreting multimodal inputs to generate complex 3D shapes, yet robust methods to evaluate geometric and structural fidelity remain underdeveloped. This paper introduces a human in the loop framework for the quantitative evaluation of LLM generated 3D models, supporting applications such as democratization of CAD design, reverse engineering of legacy designs, and rapid prototyping. We propose a comprehensive suite of similarity and complexity metrics, including volumetric accuracy, surface alignment, dimensional fidelity, and topological intricacy, to benchmark generated models against ground truth CAD references. Using an L bracket component as a case study, we systematically compare LLM performance across four input modalities: 2D orthographic views, isometric sketches, geometric structure trees, and code based correction prompts. Our findings demonstrate improved generation fidelity with increased semantic richness, with code level prompts achieving perfect reconstruction across all metrics. A key contribution of this work is demonstrating that our proposed quantitative evaluation approach enables significantly faster convergence toward the ground truth, especially compared to traditional qualitative methods based solely on visual inspection and human intuition. This work not only advances the understanding of AI assisted shape synthesis but also provides a scalable methodology to validate and refine generative models for diverse CAD applications.

3D生成大模型评估方法CAD设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。