CLAS让设计师一键搜到符合需求的3D模型,提升设计效率。
CLAS: A Machine Learning Enhanced Framework for Exploring Large 3D Design Datasets
- 基于捕获、标注、关联、搜索四步,自动化检索3D模型
- 在椅子数据集上达到MRR 0.58,Top1准确率42.27%
- 适合想快速调用3D资源的设计师与研究者使用
三维(3D)物体应用广泛。尽管学术界和工业界对3D建模兴趣日益增长,但从零开始设计或创建3D对象仍耗时且具挑战性。随着生成式人工智能的发展,设计师开始利用图像生成进行创意构思,但生成式AI在生成高质量3D对象方面仍不理想。为使3D设计师能根据具体需求访问大量3D对象,我们提出一种机器学习增强框架CLAS(Capture, Label, Associate, Search),实现基于用户规格的3D对象全自动检索,充分利用现有3D数据集。CLAS可帮助个人或组织有效利用未被使用的3D数据资产。此外,它还可用于生成高质量3D对象合成数据集,以训练和评估3D生成模型。作为概念验证,我们基于ShapeNet数据集中的6,778个椅子模型构建了一个带网页界面的搜索系统,采用CLAS实现。在闭集检索设置下,该方法达到均倒数排名(MRR)0.58,Top1准确率42.27%,Top10准确率89.64%。
原文摘要 · Abstract (English)
Three-dimensional (3D) objects have wide applications. Despite the growing interest in 3D modeling in academia and industries, designing and/or creating 3D objects from scratch remains time-consuming and challenging. With the development of generative artificial intelligence (AI), designers discover a new way to create images for ideation. However, generative AIs are less useful in creating 3D objects with satisfying qualities. To allow 3D designers to access a wide range of 3D objects for creative activities based on their specific demands, we propose a machine learning (ML) enhanced framework CLAS - named after the four-step of capture, label, associate, and search - to enable fully automatic retrieval of 3D objects based on user specifications leveraging the existing datasets of 3D objects. CLAS provides an effective and efficient method for any person or organization to benefit from their existing but not utilized 3D datasets. In addition, CLAS may also be used to produce high-quality 3D object synthesis datasets for training and evaluating 3D generative models. As a proof of concept, we created and showcased a search system with a web user interface (UI) for retrieving 6,778 3D objects of chairs in the ShapeNet dataset powered by CLAS. In a close-set retrieval setting, our retrieval method achieves a mean reciprocal rank (MRR) of 0.58, top 1 accuracy of 42.27%, and top 10 accuracy of 89.64%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。