针对动态图建模中关键演化子图易被随机掩码丢失的问题,提出DyGIS框架。
Informative Subgraphs Aware Masked Auto-Encoder in Dynamic Graphs
- 基于约束概率生成模型识别引导演化的关键子图
- 在11个数据集上实现多个任务的领先性能
- 适合研究动态图表示学习与自监督方法的学者
生成式自监督学习(SSL),尤其是掩码自编码器(MAE),在图机器学习中取得了显著成功并引发广泛关注。然而,现有研究在动态图上的应用仍较少。这主要因为动态图不仅包含拓扑结构信息,还蕴含时间演化依赖关系。若采用多数MAE方法中的随机掩码策略处理动态图,将导致关键的、引导演化的子图被移除,从而造成节点表示中重要时空信息的丢失。为填补这一空白,本文提出一种新型的动态图信息子图感知掩码自编码器(DyGIS)。具体而言,我们引入一个约束概率生成模型,以生成引导动态图演化的信息子图,有效缓解了动态演化子图缺失的问题。由DyGIS识别出的信息子图作为动态图掩码自编码器(DGMAE)的输入,确保了动态图中演化时空信息的完整性。在11个数据集上的大量实验表明,DyGIS在多个任务中均达到了当前最优表现。
原文摘要 · Abstract (English)
Generative self-supervised learning (SSL), especially masked autoencoders (MAE), has greatly succeeded and garnered substantial research interest in graph machine learning. However, the research of MAE in dynamic graphs is still scant. This gap is primarily due to the dynamic graph not only possessing topological structure information but also encapsulating temporal evolution dependency. Applying a random masking strategy which most MAE methods adopt to dynamic graphs will remove the crucial subgraph that guides the evolution of dynamic graphs, resulting in the loss of crucial spatio-temporal information in node representations. To bridge this gap, in this paper, we propose a novel Informative Subgraphs Aware Masked Auto-Encoder in Dynamic Graph, namely DyGIS. Specifically, we introduce a constrained probabilistic generative model to generate informative subgraphs that guide the evolution of dynamic graphs, successfully alleviating the issue of missing dynamic evolution subgraphs. The informative subgraph identified by DyGIS will serve as the input of dynamic graph masked autoencoder (DGMAE), effectively ensuring the integrity of the evolutionary spatio-temporal information within dynamic graphs. Extensive experiments on eleven datasets demonstrate that DyGIS achieves state-of-the-art performance across multiple tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。