用四次误差度量表示法生成高质量网格,解决表面缺陷与结构缺失问题。
QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation
- 基于四次误差度量(QEM)构建网格参数化表示,保留精细局部几何信息。
- 通过多解码器扩散模型生成每个体素内的多个QEM参数,实现高保真重建。
- 适用于需要精确几何细节的3D建模场景,如工业设计与数字孪生。
网格生成在3D内容创作中至关重要,广泛应用于多个工业领域。现有方法虽取得显著进展,但仍存在表面不真实、凹陷、细长部分缺失及结构不完整等问题,根源在于形状表示方式或生成网络能力不足。为此,我们扩展了基于四次误差度量(QEM)的PoNQ表示方法,提出新型模型QEMesh以生成高质量网格。PoNQ将形状表面划分为微小区域,每个区域由一个带法向和QEM矩阵的点表示,有效保留局部几何细节。在QEMesh中,我们将这些元素视为可生成参数,设计了一种包含新颖多解码器VAE的潜空间扩散模型,用于生成PoNQ参数。给定扩散模型生成的潜在编码后,三个参数解码器在每个体素单元内生成多个PoNQ参数,一个占据解码器预测哪些体素单元应包含参数以构成最终形状。大量实验表明,该方法生成的网格具有封闭表面,在多个主流指标上达到当前最优水平。
原文摘要 · Abstract (English)
Mesh generation plays a crucial role in 3D content creation, as mesh is widely used in various industrial applications. Recent works have achieved impressive results but still face several issues, such as unrealistic patterns or pits on surfaces, thin parts missing, and incomplete structures. Most of these problems stem from the choice of shape representation or the capabilities of the generative network. To alleviate these, we extend PoNQ, a Quadric Error Metrics (QEM)-based representation, and propose a novel model, QEMesh, for high-quality mesh generation. PoNQ divides the shape surface into tiny patches, each represented by a point with its normal and QEM matrix, which preserves fine local geometry information. In our QEMesh, we regard these elements as generable parameters and design a unique latent diffusion model containing a novel multi-decoder VAE for PoNQ parameters generation. Given the latent code generated by the diffusion model, three parameter decoders produce several PoNQ parameters within each voxel cell, and an occupancy decoder predicts which voxel cells containing parameters to form the final shape. Extensive evaluations demonstrate that our method generates results with watertight surfaces and is comparable to state-of-the-art methods in several main metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。