通过统一拓扑结构提升3D网格生成质量,显著保留锐利细节。
TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unification
- 用双棱柱立方体框架统一对齐真实与预测网格拓扑
- 在保持锐边的前提下实现顶点/面级显式监督,重建精度更高
- 适合需要高保真几何细节的3D生成任务
现有高保真3D生成多采用VAE-Diffusion流程,但传统VAE受限于真实网格与预测结果之间的拓扑不匹配:真实网格拓扑任意且可变,而VAE通常输出固定结构的隐式场(如规则网格上的SDF)。这种根本性错位导致无法建立明确的网格级对应关系,迫使先前工作依赖SDF或渲染损失等间接监督信号,从而难以保留细粒度几何特征,尤其是锐利边缘。为此,本文提出TopoMesh,一种基于稀疏体素的VAE,通过双棱柱立方体(DMC)拓扑框架统一真实与预测网格。具体地,我们设计了一种重网格化算法,利用L∞距离度量保留锐边,将任意输入网格转换为DMC兼容表示;解码器也输出相同格式的网格,确保目标与预测共享完全一致的拓扑结构。由此可在顶点和面层级建立显式对应关系,进而获得拓扑、顶点位置和面朝向的明确监督信号及其清晰梯度。采用教师强制与渐进分辨率训练策略,结合稀疏VAE架构,实现稳定高效收敛。大量实验表明,TopoMesh在重建保真度上显著优于现有VAE,对锐利特征和几何细节的保持能力更优。
原文摘要 · Abstract (English)
The dominant paradigm for high-fidelity 3D generation relies on a VAE-Diffusion pipeline, where the VAE's reconstruction capability sets a firm upper bound on generation quality. A fundamental challenge limiting existing VAEs is the representation mismatch between ground-truth meshes and network predictions: GT meshes have arbitrary, variable topology, while VAEs typically predict fixed-structure implicit fields (\eg, SDF on regular grids). This inherent misalignment prevents establishing explicit mesh-level correspondences, forcing prior work to rely on indirect supervision signals such as SDF or rendering losses. Consequently, fine geometric details, particularly sharp features, are poorly preserved during reconstruction. To address this, we introduce TopoMesh, a sparse voxel-based VAE that unifies both GT and predicted meshes under a shared Dual Marching Cubes (DMC) topological framework. Specifically, we convert arbitrary input meshes into DMC-compliant representations via a remeshing algorithm that preserves sharp edges using an L$\infty$ distance metric. Our decoder outputs meshes in the same DMC format, ensuring that both predicted and target meshes share identical topological structures. This establishes explicit correspondences at the vertex and face level, allowing us to derive explicit mesh-level supervision signals for topology, vertex positions, and face orientations with clear gradients. Our sparse VAE architecture employs this unified framework and is trained with Teacher Forcing and progressive resolution training for stable and efficient convergence. Extensive experiments demonstrate that TopoMesh significantly outperforms existing VAEs in reconstruction fidelity, achieving superior preservation of sharp features and geometric details.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。