解决超图网络层数加深时的特征模糊问题,提升层次结构建模能力。
Residual Hyperbolic Graph Convolution Networks
- 引入超双曲残差连接,保留节点初始信息防止特征退化。
- 在多流形结构中设置不同原点,增强特征表达多样性。
- 使用超双曲随机丢弃缓解过拟合,保持几何结构完整性。
超双曲图卷积网络(HGCNs)在建模层次结构图方面表现出强大表征能力。然而,与普通GCN类似,随着模型层数增加,仍会出现过平滑问题,限制了现有HGCN模型的表征性能。本文提出残差超双曲图卷积网络(R-HGCNs)以解决过平滑问题。我们设计了超双曲残差连接函数,并理论证明其有效性。同时,采用乘积流形和HyperDrop机制提升R-HGCNs性能。主要特点包括:(1) 超双曲残差连接在每层保留初始节点信息,通过超双曲恒等映射防止节点特征不可区分;(2) 多流形结构中各组件设定不同原点,从更广视角提取特征信息,增强表示能力;(3) HyperDrop向超双曲表示添加乘性高斯噪声,在不破坏超双曲几何的前提下引入扰动,缓解过拟合。实验表明,R-HGCNs在不同卷积层数及多流形结构下均表现优异。
原文摘要 · Abstract (English)
Hyperbolic graph convolutional networks (HGCNs) have demonstrated representational capabilities of modeling hierarchical-structured graphs. However, as in general GCNs, over-smoothing may occur as the number of model layers increases, limiting the representation capabilities of most current HGCN models. In this paper, we propose residual hyperbolic graph convolutional networks (R-HGCNs) to address the over-smoothing problem. We introduce a hyperbolic residual connection function to overcome the over-smoothing problem, and also theoretically prove the effectiveness of the hyperbolic residual function. Moreover, we use product manifolds and HyperDrop to facilitate the R-HGCNs. The distinctive features of the R-HGCNs are as follows: (1) The hyperbolic residual connection preserves the initial node information in each layer and adds a hyperbolic identity mapping to prevent node features from being indistinguishable. (2) Product manifolds in R-HGCNs have been set up with different origin points in different components to facilitate the extraction of feature information from a wider range of perspectives, which enhances the representing capability of R-HGCNs. (3) HyperDrop adds multiplicative Gaussian noise into hyperbolic representations, such that perturbations can be added to alleviate the over-fitting problem without deconstructing the hyperbolic geometry. Experiment results demonstrate the effectiveness of R-HGCNs under various graph convolution layers and different structures of product manifolds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。