arXiv:2412.09548cs.GRcs.CV2024-12被引 93

Meshtron可规模化生成高精度3D网格,细节媲美专业艺术家创作。

Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scale

  • 采用分层神经架构与滑动窗口推理,实现大规模网格渐进生成。
  • 支持最多64K面、1024级坐标精度,比现有方法高8倍分辨率。
  • 适合需要高保真3D资产的动画、游戏与虚拟现实领域使用。

网格是三维表面的基本表示形式。然而,创建高质量网格是一项耗时且依赖专业知识的任务。精细物体通常需要超过10⁴个面才能准确建模,而现有生成艺术风格网格的方法最多仅支持1.6K面,并存在顶点坐标的严重离散化问题。因此,提升最大面数和顶点坐标分辨率对生成真实复杂三维物体的高质量网格至关重要。我们提出Meshtron,一种新型自回归网格生成模型,可生成最多达64K面、1024级坐标分辨率的网格——面数超过当前最先进方法一个数量级,坐标分辨率提升8倍。其可扩展性由四个关键组件驱动:(1) 分层神经架构,(2) 截断序列训练,(3) 滑动窗口推理,(4) 保证网格序列顺序的鲁棒采样策略。该设计使训练内存减少50%以上,吞吐量提升2.5倍,且生成结果更一致。Meshtron能以前所未有的分辨率与保真度生成复杂三维物体网格,高度接近专业艺术家创作效果,为动画、游戏及虚拟环境中的高细节3D资产生成开辟新可能。

原文摘要 · Abstract (English)

Meshes are fundamental representations of 3D surfaces. However, creating high-quality meshes is a labor-intensive task that requires significant time and expertise in 3D modeling. While a delicate object often requires over $10^4$ faces to be accurately modeled, recent attempts at generating artist-like meshes are limited to $1.6$K faces and heavy discretization of vertex coordinates. Hence, scaling both the maximum face count and vertex coordinate resolution is crucial to producing high-quality meshes of realistic, complex 3D objects. We present Meshtron, a novel autoregressive mesh generation model able to generate meshes with up to 64K faces at 1024-level coordinate resolution --over an order of magnitude higher face count and $8{\times}$ higher coordinate resolution than current state-of-the-art methods. Meshtron's scalability is driven by four key components: (1) an hourglass neural architecture, (2) truncated sequence training, (3) sliding window inference, (4) a robust sampling strategy that enforces the order of mesh sequences. This results in over $50{\%}$ less training memory, $2.5{\times}$ faster throughput, and better consistency than existing works. Meshtron generates meshes of detailed, complex 3D objects at unprecedented levels of resolution and fidelity, closely resembling those created by professional artists, and opening the door to more realistic generation of detailed 3D assets for animation, gaming, and virtual environments.

3D生成网格生成高保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。