深度学习让草图生成3D模型更准更快，人机协作更自然。
Deep Sketch-Based 3D Modeling: A Survey
- 基于输入-模型-输出框架，系统梳理草图转3D的方法
- 提出新型设计空间MORPHEUS，统一分类各类3D建模方案
- 适合关注人机交互与3D生成的视觉/图形领域研究者
过去十年，人工智能的发展推动了草图驱动3D建模的革新，形成名为深度草图驱动3D建模（DS-3DM）的新范式。该方法通过数据驱动手段解决了草图抽象与歧义的长期难题，以人类为中心提升建模界面的灵活性、可用性、忠实度与适应性。本文提出一个全面综述，构建在全新设计空间MORPHEUS中。基于输入-模型-输出（IMO）框架，MORPHEUS将模型输出的3D表示与部件选项，根据人类输入（数量与模态多样性）以及用户视角与风格评估进行分类。在此框架下，我们揭示现有方法的局限性，并指出计算机视觉、计算机图形学与人机交互领域的跨学科研究机会，强调可控性与信息丰富输出的必要性，使设计过程更贴近用户意图，响应日益重要的以用户为中心的设计趋势。
原文摘要 · Abstract (English)
In the past decade, advances in artificial intelligence have revolutionized sketch-based 3D modeling, leading to a new paradigm known as Deep Sketch-Based 3D Modeling (DS-3DM). DS-3DM offers data-driven methods that address the long-standing challenges of sketch abstraction and ambiguity. DS-3DM keeps humans at the center of the creative process by enhancing the flexibility, usability, faithfulness, and adaptability of sketch-based 3D modeling interfaces. This paper contributes a comprehensive survey of the latest DS-3DM within a novel design space: MORPHEUS. Built upon the Input-Model-Output (IMO) framework, MORPHEUS categorizes Models outputting Options of 3D Representations and Parts, derived from Human inputs (varying in quantity and modality), and Evaluated across diverse User-views and Styles. Throughout MORPHEUS we highlight limitations and identify opportunities for interdisciplinary research in Computer Vision, Computer Graphics, and Human-Computer Interaction, revealing a need for controllability and information-rich outputs. These opportunities align design processes more closely with user' intent, responding to the growing importance of user-centered approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。