研究图神经网络中信息传播机制,提升长期依赖建模能力
Information propagation dynamics in Deep Graph Networks
- 将图网络视为动力系统,设计可学习的信息传播模式
- 在动态图上有效捕捉复杂时空依赖,支持稀疏采样场景
- 为图表示学习提供理论与实践双重支撑,适合模型设计者参考
图是一种高度表达性的抽象结构,用于建模分子结构、社交网络和交通网络等实体及其关系。深度图网络(DGNs)作为一类深度学习模型,能够有效处理此类结构化信息。然而,在静态与动态图中学习有效的信息传播模式仍是关键挑战,直接影响模型性能。本文从动力系统视角出发,研究静态与动态图中信息传播的动力学特性。通过理论与实证分析,验证了所提架构在保持节点间长期依赖、从不规则且稀疏采样的动态图中学习复杂时空模式方面的有效性。本研究系统探索了图、深度学习与动力系统之间的交叉,为图表示学习提供新见解,并推动更高效、通用的图学习模型发展。
原文摘要 · Abstract (English)
Graphs are a highly expressive abstraction for modeling entities and their relations, such as molecular structures, social networks, and traffic networks. Deep Graph Networks (DGNs) have emerged as a family of deep learning models that can effectively process and learn such structured information. However, learning effective information propagation patterns within DGNs remains a critical challenge that heavily influences the model capabilities, both in the static domain and in the temporal domain (where features and/or topology evolve). Given this challenge, this thesis investigates the dynamics of information propagation within DGNs for static and dynamic graphs, focusing on their design as dynamical systems. Throughout this work, we provide theoretical and empirical evidence to demonstrate the effectiveness of our proposed architectures in propagating and preserving long-term dependencies between nodes, and in learning complex spatio-temporal patterns from irregular and sparsely sampled dynamic graphs. In summary, this thesis provides a comprehensive exploration of the intersection between graphs, deep learning, and dynamical systems, offering insights and advancements for the field of graph representation learning and paving the way for more effective and versatile graph-based learning models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。