用离散扩散模型并行生成高保真3D网格,支持艺术家风格建模。
Topology Sculptor, Shape Refiner: Discrete Diffusion Model for High-Fidelity 3D Meshes Generation
- 分阶段生成:先拓扑雕刻后形状精修,提升结构与细节质量。
- 最高生成10,000面、1024³空间分辨率的高质量3D网格。
- 适合需要高效生成高精度3D模型的动画/游戏设计人员。
本文提出拓扑雕刻师与形状精修器(TSSR),一种基于离散扩散模型(DDMs)生成高质量艺术家风格3D网格的新方法。其核心目标是实现高精度标记预测并支持并行生成,显著优于传统序列自回归方法。通过让TSSR同时“看见”所有网格标记,我们实现了更高效率与控制力。关键创新包括:1)解耦训练与混合推理,将生成过程分为拓扑雕刻与形状精修两阶段,有效捕捉局部拓扑与全局形态;2)改进的钟形网络架构,引入面-顶点-序列级旋转位置编码(RoPE),增强网格结构上下文感知;3)新型连接损失,作为拓扑约束,进一步提升生成网格的真实感与保真度。在复杂数据集上的大量实验表明,TSSR可生成高达10,000面、空间分辨率达$1024^3$的高质量3D网格。代码将发布于:https://github.com/psky1111/Tencent-TSSR。
原文摘要 · Abstract (English)
In this paper, we introduce Topology Sculptor, Shape Refiner (TSSR), a novel method for generating high-quality, artist-style 3D meshes based on Discrete Diffusion Models (DDMs). Our primary motivation for TSSR is to achieve highly accurate token prediction while enabling parallel generation, a significant advantage over sequential autoregressive methods. By allowing TSSR to "see" all mesh tokens concurrently, we unlock a new level of efficiency and control. We leverage this parallel generation capability through three key innovations: 1) Decoupled Training and Hybrid Inference, which distinctly separates the DDM-based generation into a topology sculpting stage and a subsequent shape refinement stage. This strategic decoupling enables TSSR to effectively capture both intricate local topology and overarching global shape. 2) An Improved Hourglass Architecture, featuring bidirectional attention enriched by face-vertex-sequence level Rotational Positional Embeddings (RoPE), thereby capturing richer contextual information across the mesh structure. 3) A novel Connection Loss, which acts as a topological constraint to further enhance the realism and fidelity of the generated meshes. Extensive experiments on complex datasets demonstrate that TSSR generates high-quality 3D artist-style meshes, capable of achieving up to 10,000 faces at a remarkable spatial resolution of $1024^3$. The code will be released at: https://github.com/psky1111/Tencent-TSSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。