提出新型图神经网络CSNN,解决传统方法信息传播不灵活问题。
Cooperative Sheaf Neural Networks
- 基于有向图上的细胞层结构设计新消息传递机制
- 可选择性地远距离接收信息,避免信息过度压缩
- 在异质图上表现优于现有层间扩散与合作式GNN
层扩散近年来因其处理异质数据和避免过平滑的潜力,成为图表示学习的重要设计模式。与此同时,合作式消息传递也被提出,通过允许节点自主决定是否从邻居接收或传播信息,增强信息扩散的灵活性。一个自然的问题是:层扩散能否实现这种合作行为?本文给出否定回答——现有层扩散方法因缺乏消息方向性而无法实现合作行为。为克服此限制,我们引入有向图上的细胞层概念,并刻画其入度与出度拉普拉斯算子。基于该构造,我们提出合作层神经网络(CSNN)。理论上,我们刻画了CSNN的感受野,表明其可选择性地远距离监听任意节点,同时忽略路径中其他节点,有望缓解信息挤压问题。实验表明,与以往层扩散及合作式图神经网络相比,CSNN整体性能更优。
原文摘要 · Abstract (English)
Sheaf diffusion has recently emerged as a promising design pattern for graph representation learning due to its inherent ability to handle heterophilic data and avoid oversmoothing. Meanwhile, cooperative message passing has also been proposed as a way to enhance the flexibility of information diffusion by allowing nodes to independently choose whether to propagate/gather information from/to neighbors. A natural question ensues: is sheaf diffusion capable of exhibiting this cooperative behavior? Here, we provide a negative answer to this question. In particular, we show that existing sheaf diffusion methods fail to achieve cooperative behavior due to the lack of message directionality. To circumvent this limitation, we introduce the notion of cellular sheaves over directed graphs and characterize their in- and out-degree Laplacians. We leverage our construction to propose Cooperative Sheaf Neural Networks (CSNNs). Theoretically, we characterize the receptive field of CSNN and show it allows nodes to selectively attend (listen) to arbitrarily far nodes while ignoring all others in their path, potentially mitigating oversquashing. Our experiments show that CSNN presents overall better performance compared to prior art on sheaf diffusion as well as cooperative graph neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。