提出高阶表示的EGNN变体,提升对称结构建模能力
Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?
- 用高阶可旋向量替代仅用一阶向量的消息传递
- 在对称结构上理论证明一阶输出会退化为零函数
- 新模型HEGNN兼顾表达力与效率,适合物理模拟任务
包含E(3)对称性的等变图神经网络在科学计算中表现优异。当前最成功的EGNN模型通过标量化解耦技术,仅使用笛卡尔向量(即一阶可旋向量)进行等变消息传递,相比使用高阶可旋向量的模型更具效率和效果。这暗示高阶表示可能不必要。本文通过研究对称结构(如k重旋转、正多面体)上的等变GNN表达能力,从理论上证明:若输出表示的阶数固定为1或其他特定值,等变GNN将始终退化为零函数。基于此,我们提出HEGNN——一种高阶版本的EGNN,通过引入高阶可旋向量提升表达力,同时保留标量化解耦技巧以维持效率。大量实验表明,HEGNN不仅在含对称结构的玩具数据集上符合理论分析,还在更复杂的N-body和MD17数据集上实现显著性能提升。理论发现与实证结果为等变GNN研究开辟了新方向。
原文摘要 · Abstract (English)
Equivariant Graph Neural Networks (GNNs) that incorporate E(3) symmetry have achieved significant success in various scientific applications. As one of the most successful models, EGNN leverages a simple scalarization technique to perform equivariant message passing over only Cartesian vectors (i.e., 1st-degree steerable vectors), enjoying greater efficiency and efficacy compared to equivariant GNNs using higher-degree steerable vectors. This success suggests that higher-degree representations might be unnecessary. In this paper, we disprove this hypothesis by exploring the expressivity of equivariant GNNs on symmetric structures, including $k$-fold rotations and regular polyhedra. We theoretically demonstrate that equivariant GNNs will always degenerate to a zero function if the degree of the output representations is fixed to 1 or other specific values. Based on this theoretical insight, we propose HEGNN, a high-degree version of EGNN to increase the expressivity by incorporating high-degree steerable vectors while maintaining EGNN's efficiency through the scalarization trick. Our extensive experiments demonstrate that HEGNN not only aligns with our theoretical analyses on toy datasets consisting of symmetric structures, but also shows substantial improvements on more complicated datasets such as $N$-body and MD17. Our theoretical findings and empirical results potentially open up new possibilities for the research of equivariant GNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。