arXiv:2412.18316cs.LGcs.AI2024-12被引 1

自动学习图数据增强策略,提升自监督图表示学习效果

Data-Driven Self-Supervised Graph Representation Learning

  • 基于节点特征与拓扑信息,自动学习可学习的多视图增强
  • 在9个节点分类和8个图属性预测任务中达到或超过当前最优
  • 适用于异构与同构图,无需人工设计增强规则

自监督图表示学习(SSGRL)旨在减少或避免人工标注。其关键在于图数据增强,但现有方法依赖凭经验的启发式规则,仅在特定领域有效,且难以解释其优劣。此外,某些技术(如丢弃法)可能改变分子图特性或破坏文档分类中的重要信号。本文提出一种数据驱动的SSGRL方法,直接从图中编码的信号(即节点预测特征与拓扑信息)中自动学习合适的图增强策略。提出两种互补方法:一种学习节点特征的多视图增强,另一种学习高阶拓扑视图。增强策略与表示学习联合优化。该方法具有通用性,适用于同构与异构图。在9个同构/异构节点分类数据集和8个图属性预测数据集上进行大量实验,结果表明该方法性能达到或超过当前最优的自监督基线,并接近半监督方法水平。匿名源码已公开于https://github.com/AhmedESamy/dsgrl/

原文摘要 · Abstract (English)

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly identified through trial and error and are effective only within some application domains. Also, it is not clear why one heuristic is better than another. Moreover, recent studies have argued against some techniques (e.g., dropout: that can change the properties of molecular graphs or destroy relevant signals for graph-based document classification tasks). In this study, we propose a novel data-driven SSGRL approach that automatically learns a suitable graph augmentation from the signal encoded in the graph (i.e., the nodes' predictive feature and topological information). We propose two complementary approaches that produce learnable feature and topological augmentations. The former learns multi-view augmentation of node features, and the latter learns a high-order view of the topology. Moreover, the augmentations are jointly learned with the representation. Our approach is general that it can be applied to homogeneous and heterogeneous graphs. We perform extensive experiments on node classification (using nine homogeneous and heterogeneous datasets) and graph property prediction (using another eight datasets). The results show that the proposed method matches or outperforms the SOTA SSGRL baselines and performs similarly to semi-supervised methods. The anonymised source code is available at https://github.com/AhmedESamy/dsgrl/

图神经网络自监督学习数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。