用空间域各向异性卷积,同时捕捉3D网格的局部细节和全局结构。
Self-Attention Based Multi-Scale Graph Auto-Encoder Network of 3D Meshes
- 基于多尺度编码器-解码器设计,分离处理全局与局部特征
- 在COMA数据集上实现更高精度的网格重建效果
- 无需转为体素或点云,直接处理原始多边形网格
3D网格是计算机视觉与图形学中表征复杂几何形状的基础数据形式。尽管卷积神经网络(CNN)在图像等规则数据上表现优异,但将其推广至不规则3D网格面临非欧几里得数据的挑战。图卷积网络(GCN)通过在图结构数据上应用卷积提供了解决方案,但现有方法多依赖各向同性滤波器或谱分解,难以同时捕捉局部与全局特征。本文提出3DGeometric Mesh Network(3DGeoMeshNet),一种基于GCN的新框架,采用各向异性卷积层,在空间域中直接学习全局与局部特征。不同于将网格转换为体素网格或点云的中间表示,本方法全程保留原始多边形网格格式,实现更精准的形状重建。架构包含多尺度编码器-解码器结构,分别通过全局与局部路径捕捉大尺度几何结构与精细局部细节。在包含人脸的COMA数据集上的大量实验表明,3DGeoMeshNet在重建精度方面具有显著优势。
原文摘要 · Abstract (English)
3D meshes are fundamental data representations for capturing complex geometric shapes in computer vision and graphics applications. While Convolutional Neural Networks (CNNs) have excelled in structured data like images, extending them to irregular 3D meshes is challenging due to the non-Euclidean nature of the data. Graph Convolutional Networks (GCNs) offer a solution by applying convolutions to graph-structured data, but many existing methods rely on isotropic filters or spectral decomposition, limiting their ability to capture both local and global mesh features. In this paper, we introduce 3D Geometric Mesh Network (3DGeoMeshNet), a novel GCN-based framework that uses anisotropic convolution layers to effectively learn both global and local features directly in the spatial domain. Unlike previous approaches that convert meshes into intermediate representations like voxel grids or point clouds, our method preserves the original polygonal mesh format throughout the reconstruction process, enabling more accurate shape reconstruction. Our architecture features a multi-scale encoder-decoder structure, where separate global and local pathways capture both large-scale geometric structures and fine-grained local details. Extensive experiments on the COMA dataset containing human faces demonstrate the efficiency of 3DGeoMeshNet in terms of reconstruction accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。