用最优传输生成规则网格图,单次前向传播恢复高质量3D网格。
Neural Geometry Image-Based Representations with Optimal Transport (OT)
- 将不规则网格转为规则图像网格,直接使用图像处理技术。
- 压缩比、切比雪夫距离和豪斯多夫距离均达当前最优水平。
- 适合需要高效存储与快速重建的3D模型应用。
3D网格的神经表示正成为紧凑存储与高效处理的有效方案。现有方法常依赖神经过拟合,通过多个解码器逐步精炼粗糙网格,虽可恢复高质量表面,但因连续解码过程和网格数据的不规则结构而计算开销大。相比之下,图像具有规则结构,支持强大的超分辨率与修复框架,但将其应用于网格困难,因其不规则连接需复杂编码-解码架构。我们的核心洞察是:基于几何图像的表示可将不规则网格转换为规则图像网格,使高效的图像神经处理直接可用。基于此,我们提出无解码器、存储高效且天然适配神经处理的神经几何图像表示。它存储表面的低分辨率几何图像多级细节(mipmap),仅需一次前向传播即可还原高质量网格。构建几何图像时,我们利用最优传输(OT),解决平坦区域过采样与特征丰富区域欠采样问题,并通过几何图像多级细节实现连续细节层次(LoD)。实验结果表明,该方法在压缩比(CR)、切比雪夫距离(CD)和豪斯多夫距离(HD)上均达到当前最优水平。
原文摘要 · Abstract (English)
Neural representations for 3D meshes are emerging as an effective solution for compact storage and efficient processing. Existing methods often rely on neural overfitting, where a coarse mesh is stored and progressively refined through multiple decoder networks. While this can restore high-quality surfaces, it is computationally expensive due to successive decoding passes and the irregular structure of mesh data. In contrast, images have a regular structure that enables powerful super-resolution and restoration frameworks, but applying these advantages to meshes is difficult because their irregular connectivity demands complex encoder-decoder architectures. Our key insight is that a geometry image-based representation transforms irregular meshes into a regular image grid, making efficient image-based neural processing directly applicable. Building on this idea, we introduce our neural geometry image-based representation, which is decoder-free, storage-efficient, and naturally suited for neural processing. It stores a low-resolution geometry-image mipmap of the surface, from which high-quality meshes are restored in a single forward pass. To construct geometry images, we leverage Optimal Transport (OT), which resolves oversampling in flat regions and undersampling in feature-rich regions, and enables continuous levels of detail (LoD) through geometry-image mipmapping. Experimental results demonstrate state-of-the-art storage efficiency and restoration accuracy, measured by compression ratio (CR), Chamfer distance (CD), and Hausdorff distance (HD).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。