用曲率提升图结构,缓解长距离信息传递中的过压缩问题。
A Remedy for Over-Squashing in Graph Learning via Forman-Ricci Curvature based Graph-to-Hypergraph Structural Lifting
- 基于Forman-Ricci曲率构建边级特征,识别网络骨干结构。
- 将核心连接转为超边,有效减少长距消息传递中的信息失真。
- 适合处理社交、生物等复杂高阶交互网络,提升模型表达能力。
图神经网络在关系数据学习中表现优异,能利用节点与边特征并保持图结构的对称性。然而,现实世界系统如社交或生物网络常存在更复杂的高阶交互,更适合用更高阶拓扑结构表示。几何与拓扑深度学习(TDL)通过引入高阶结构来应对这一挑战。其中关键在于“提升”:将数据从基础图结构转换为更具表达力的拓扑形式。本文提出一种基于Forman-Ricci曲率的结构提升策略,该曲率源自黎曼几何,定义了基于边的网络特性,可揭示图的局部与全局属性,如网络骨干——即保留结构的粗粒度几何形态,连接主要社区。这些骨干结构最适于以超边形式建模跨远距离的信息流动。本方法有效缓解了消息传递中因长距离传播和图瓶颈导致的信息扭曲现象,即图学习中的过压缩问题。
原文摘要 · Abstract (English)
Graph Neural Networks are highly effective at learning from relational data, leveraging node and edge features while maintaining the symmetries inherent to graph structures. However, many real-world systems, such as social or biological networks, exhibit complex interactions that are more naturally represented by higher-order topological domains. The emerging field of Geometric and Topological Deep Learning addresses this challenge by introducing methods that utilize and benefit from higher-order structures. Central to TDL is the concept of lifting, which transforms data representations from basic graph forms to more expressive topologies before the application of GNN models for learning. In this work, we propose a structural lifting strategy using Forman-Ricci curvature, which defines an edge-based network characteristic based on Riemannian geometry. Curvature reveals local and global properties of a graph, such as a network's backbones, i.e. coarse, structure-preserving graph geometries that form connections between major communities - most suitably represented as hyperedges to model information flows between clusters across large distances in the network. To this end, our approach provides a remedy to the problem of information distortion in message passing across long distances and graph bottlenecks - a phenomenon known in graph learning as over-squashing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。