arXiv:2502.01814cs.CVcs.LG2025-02ICLR被引 2

用带表面属性的图建模多面体,提升3D形状表征能力。

PolyhedronNet: Representation Learning for Polyhedra with Surface-attributed Graph

  • 将多面体构建成包含顶点、边、面及其关系的表面属性图。
  • 通过局部刚性表示与分层消息传递,实现无损全局表征。
  • 适用于需要精细几何建模的3D形状分类与检索任务。

多面体是精确且高效的几何对象表示方式。将多面体转化为向量(即多面体表征学习)对分类、聚类和生成等任务至关重要。近年来虽有显著进展,但多数方法仅关注顶点序列,忽略了真实多面体中复杂的表面建模。本文提出PolyhedronNet,一种专为3D多面体对象设计的通用表征学习框架。我们引入表面属性图概念,无缝建模多面体中的顶点、边、面及其几何关联。为有效学习整个表面属性图的表征,首先将其分解为局部刚性表示,以在不丢失几何信息的前提下学习各局部区域相对于其余区域的相对位置。随后,提出PolyhedronGNN,通过面内与面间几何消息传递模块,分层聚合局部刚性表示,获得保持旋转平移不变性且信息损失最小的全局表征。在四个不同数据集上的实验评估表明,PolyhedronNet能有效捕捉3D多面体对象的全面且富有信息量的表征。代码与数据见:https://github.com/dyu62/3D_polyhedron。

原文摘要 · Abstract (English)

Ubiquitous geometric objects can be precisely and efficiently represented as polyhedra. The transformation of a polyhedron into a vector, known as polyhedra representation learning, is crucial for manipulating these shapes with mathematical and statistical tools for tasks like classification, clustering, and generation. Recent years have witnessed significant strides in this domain, yet most efforts focus on the vertex sequence of a polyhedron, neglecting the complex surface modeling crucial in real-world polyhedral objects. This study proposes \textbf{PolyhedronNet}, a general framework tailored for learning representations of 3D polyhedral objects. We propose the concept of the surface-attributed graph to seamlessly model the vertices, edges, faces, and their geometric interrelationships within a polyhedron. To effectively learn the representation of the entire surface-attributed graph, we first propose to break it down into local rigid representations to effectively learn each local region's relative positions against the remaining regions without geometric information loss. Subsequently, we propose PolyhedronGNN to hierarchically aggregate the local rigid representation via intra-face and inter-face geometric message passing modules, to obtain a global representation that minimizes information loss while maintaining rotation and translation invariance. Our experimental evaluations on four distinct datasets, encompassing both classification and retrieval tasks, substantiate PolyhedronNet's efficacy in capturing comprehensive and informative representations of 3D polyhedral objects. Code and data are available at {https://github.com/dyu62/3D_polyhedron}.

3D表征图神经网络多面体建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。