arXiv:2503.01425cs.GRcs.CV2025-03ICCV被引 8

用草图交互生成编辑3D网格,支持快速修改与高质量输出。

MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editing

  • 通过草图删减与添加区域实现可交互的网格编辑
  • 在Chamfer距离上提升超22%质量,90%用户更偏好
  • 基于变换器的顶点对齐预测,每步编辑仅数秒完成

我们提出MeshPad,一种从草图输入生成3D网格的生成方法。基于近期艺术家风格三角网格生成进展,该方法满足交互式网格创建需求。为此,我们将编辑分解为‘删除’网格区域,再‘添加’新几何结构,通过简单草图修改即可触发,支持迭代内容创作并构建复杂3D网格。方法采用基于三角序列的网格表示,利用大型Transformer模型进行三角形增删。为实现交互式编辑,我们在加法网格生成器基础上引入顶点对齐的推测预测策略,能为每个顶点预测多个输出标记,显著降低推理计算成本,使每次编辑步骤仅需数秒。全面实验表明,MeshPad优于现有最先进草图条件网格生成方法,在Chamfer距离上提升超过22%,且在感知评估中获得90%参与者青睐。

原文摘要 · Abstract (English)

We introduce MeshPad, a generative approach that creates 3D meshes from sketch inputs. Building on recent advances in artist-reminiscent triangle mesh generation, our approach addresses the need for interactive mesh creation. To this end, we focus on enabling consistent edits by decomposing editing into 'deletion' of regions of a mesh, followed by 'addition' of new mesh geometry. Both operations are invoked by simple user edits of a sketch image, facilitating an iterative content creation process and enabling the construction of complex 3D meshes. Our approach is based on a triangle sequence-based mesh representation, exploiting a large Transformer model for mesh triangle addition and deletion. In order to perform edits interactively, we introduce a vertex-aligned speculative prediction strategy on top of our additive mesh generator. This speculator predicts multiple output tokens corresponding to a vertex, thus significantly reducing the computational cost of inference and accelerating the editing process, making it possible to execute each editing step in only a few seconds. Comprehensive experiments demonstrate that MeshPad outperforms state-of-the-art sketch-conditioned mesh generation methods, achieving more than 22% mesh quality improvement in Chamfer distance, and being preferred by 90% of participants in perceptual evaluations.

3D生成草图生成交互编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。