让AI根据人体和语义提示生成可虚拟模拟或实体制造的3D物体。
CRAFT: Designing Creative and Functional 3D Objects
- 通过优化语义对齐、接触与穿透损失实现体感3D物体生成
- 支持文本、图像、草图输入，生成物可在虚拟角色上模拟或打印
- 无需人工干预，适用于设计师和普通用户快速创作
为设计各类日常物品，设计过程需兼顾人体特征与设计语义。然而，当前基于AI的设计工具难以同时满足这两点。本文提出一种从基础网格出发，结合输入的人体几何结构及文本或图像引导，生成体感3D物体的方法。生成物可应用于虚拟角色模拟或真实世界制造。方法采用网格变形策略，优化语义对齐、接触与穿透损失。实验表明，该方法在多种物体类别上均能生成高质量结果，支持文本、图像或草图输入，无需人工干预，具备广泛适用性。
原文摘要 · Abstract (English)
For designing a wide range of everyday objects, the design process should be aware of both the human body and the underlying semantics of the design specification. However, these two objectives present significant challenges to the current AI-based designing tools. In this work, we present a method to synthesize body-aware 3D objects from a base mesh given an input body geometry and either text or image as guidance. The generated objects can be simulated on virtual characters, or fabricated for real-world use. We propose to use a mesh deformation procedure that optimizes for both semantic alignment as well as contact and penetration losses. Using our method, users can generate both virtual or real-world objects from text, image, or sketch, without the need for manual artist intervention. We present both qualitative and quantitative results on various object categories, demonstrating the effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。