用稀疏表示提升高分辨率3D建模精度与效率
Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling
- 提出稀疏可变形网格表示Sparcubes,实现高精度表面重建
- 构建首个基于稀疏卷积的自编码器,支持1024³级分辨率生成
- 适合需要细节保留的3D生成任务,如工业设计与数字孪生
高保真3D物体生成比2D图像生成更具挑战性,原因在于网格数据的非结构化特性以及密集体素网格的立方复杂度。现有两阶段方法(先用VAE压缩网格,再进行隐空间扩散采样)常因表示效率低和模态不匹配导致细节丢失。本文提出Sparc3D统一框架,结合稀疏可变形网格表示Sparcubes与新型编码器Sparconv-VAE。Sparcubes通过将符号距离场与形变场投射到稀疏立方体中,实现任意拓扑的高分辨率(1024³)表面重建,并支持可微优化。Sparconv-VAE是首个完全基于稀疏卷积网络构建的模态一致自编码器,实现高效且近乎无损的3D重建,适用于高分辨率生成建模。Sparc3D在包含开放曲面、多连通组件及复杂几何的挑战性输入上达到最优重建保真度,有效保留细粒度形状特征,降低训练与推理成本,并可自然集成至隐空间扩散模型,支持可扩展的高分辨率3D生成。
原文摘要 · Abstract (English)
High-fidelity 3D object synthesis remains significantly more challenging than 2D image generation due to the unstructured nature of mesh data and the cubic complexity of dense volumetric grids. Existing two-stage pipelines-compressing meshes with a VAE (using either 2D or 3D supervision), followed by latent diffusion sampling-often suffer from severe detail loss caused by inefficient representations and modality mismatches introduced in VAE. We introduce Sparc3D, a unified framework that combines a sparse deformable marching cubes representation Sparcubes with a novel encoder Sparconv-VAE. Sparcubes converts raw meshes into high-resolution ($1024^3$) surfaces with arbitrary topology by scattering signed distance and deformation fields onto a sparse cube, allowing differentiable optimization. Sparconv-VAE is the first modality-consistent variational autoencoder built entirely upon sparse convolutional networks, enabling efficient and near-lossless 3D reconstruction suitable for high-resolution generative modeling through latent diffusion. Sparc3D achieves state-of-the-art reconstruction fidelity on challenging inputs, including open surfaces, disconnected components, and intricate geometry. It preserves fine-grained shape details, reduces training and inference cost, and integrates naturally with latent diffusion models for scalable, high-resolution 3D generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。