提出CLDG框架,提升动态图对比学习的稳定性与效率。
CLDG: Contrastive Learning on Dynamic Graphs
- 引入时间平移不变性,通过采样层提取持久信号
- 在7个数据集上超越8个无监督基线,性能更优
- 参数量和训练时间减少超2000倍和130倍,适合高效部署
带有复杂标注的图数据是最强大的数据类型之一,其持续演化激发了对无监督动态图表示的学习需求。代表性方法是图对比学习,通过最大化统计图增强视图间的互信息构建自监督信号。然而,在增强过程中语义和标签可能发生变化,导致下游任务性能显著下降,这一问题在动态图中尤为严重。为此,我们设计了一种简单而有效的框架CLDG。首先,我们指出动态图在不同层次具有时间平移不变性;随后,提出采样层以提取时间上持久的信号,促使节点在时间跨度视图下保持一致的局部与全局表示,即实现时间平移不变性。大量实验表明,该方法在七个数据集上优于八个无监督最先进的基线,并展现出与四个半监督方法相当的竞争力。相较于现有动态图方法,模型参数量平均减少2,001.86倍,训练时间平均减少130.31倍。
原文摘要 · Abstract (English)
The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It constructs self-supervised signals by maximizing the mutual information between the statistic graph's augmentation views. However, the semantics and labels may change within the augmentation process, causing a significant performance drop in downstream tasks. This drawback becomes greatly magnified on dynamic graphs. To address this problem, we designed a simple yet effective framework named CLDG. Firstly, we elaborate that dynamic graphs have temporal translation invariance at different levels. Then, we proposed a sampling layer to extract the temporally-persistent signals. It will encourage the node to maintain consistent local and global representations, i.e., temporal translation invariance under the timespan views. The extensive experiments demonstrate the effectiveness and efficiency of the method on seven datasets by outperforming eight unsupervised state-of-the-art baselines and showing competitiveness against four semi-supervised methods. Compared with the existing dynamic graph method, the number of model parameters and training time is reduced by an average of 2,001.86 times and 130.31 times on seven datasets, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。