用图神经网络直接处理不规则网格,提升3D模型学习效率
InfoGNN: End-to-end deep learning on mesh via graph neural networks
- 将网格转为图结构,用GNN端到端学习
- 融合点位、法向、二面角等几何信息,提升特征表达
- 适合需要高效处理复杂3D网格的科研与工业应用
3D模型广泛应用于各行业,网格数据因其能直观表达丰富的三维信息而成为关键。然而,其无序、非规则的数据结构和复杂的表面特性,使得深度学习模型难以直接应用。传统方法受限于流形假设等条件,适用范围有限。本文提出基于图神经网络的端到端框架InfoGNN,将网格视为图结构,有效处理不规则数据。设计InfoConv与InfoMP模块,充分融合点位置、面法向、二面角等静态几何信息及动态全局特征。该框架简化网络设计,实现高效训练。在多个公开数据集上的实验表明,InfoGNN在网格分类与分割任务中表现优异。
原文摘要 · Abstract (English)
3D models are widely used in various industries, and mesh data has become an indispensable part of 3D modeling because of its unique advantages. Mesh data can provide an intuitive and practical expression of rich 3D information. However, its disordered, irregular data structure and complex surface information make it challenging to apply with deep learning models directly. Traditional mesh data processing methods often rely on mesh models with many limitations, such as manifold, which restrict their application scopes in reality and do not fully utilize the advantages of mesh models. This paper proposes a novel end-to-end framework for addressing the challenges associated with deep learning in mesh models centered around graph neural networks (GNN) and is titled InfoGNN. InfoGNN treats the mesh model as a graph, which enables it to handle irregular mesh data efficiently. Moreover, we propose InfoConv and InfoMP modules, which utilize the position information of the points and fully use the static information such as face normals, dihedral angles, and dynamic global feature information to fully use all kinds of data. In addition, InfoGNN is an end-to-end framework, and we simplify the network design to make it more efficient, paving the way for efficient deep learning of complex 3D models. We conducted experiments on several publicly available datasets, and the results show that InfoGNN achieves excellent performance in mesh classification and segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。