通过目标感知对比学习提升节点表示质量,增强下游任务性能。
Improving Node Representation by Boosting Target-Aware Contrastive Loss
- 设计目标感知对比损失,利用XGBoost采样器筛选正例。
- 在节点分类和链接预测任务上显著优于现有模型。
- 提升模型泛化能力,且采样权重可解释每种信号重要性。
图结构建模实体间的复杂关系,节点与边捕捉深层连接。节点表示学习将节点映射为低维嵌入,用于下游任务,其质量直接影响任务表现。现有方法包括(半)监督、无监督及自监督范式。其中(半)监督学习仅基于类别标签优化,忽略其他丰富图信号,限制泛化能力;而自监督或无监督学习虽能更好捕捉图信号,但这些信号对下游任务的有用性不一。为此,本文提出目标感知对比学习(Target-aware CL),通过自监督过程最大化目标任务与节点表示间的互信息。该方法引入XGBoost采样器(XGSampler)选择合适的正例,以最小化目标感知对比损失(XTCL)。实验表明,相较于先进模型,该方法在节点分类与链接预测任务上均有显著提升。
原文摘要 · Abstract (English)
Graphs model complex relationships between entities, with nodes and edges capturing intricate connections. Node representation learning involves transforming nodes into low-dimensional embeddings. These embeddings are typically used as features for downstream tasks. Therefore, their quality has a significant impact on task performance. Existing approaches for node representation learning span (semi-)supervised, unsupervised, and self-supervised paradigms. In graph domains, (semi-)supervised learning often only optimizes models based on class labels, neglecting other abundant graph signals, which limits generalization. While self-supervised or unsupervised learning produces representations that better capture underlying graph signals, the usefulness of these captured signals for downstream target tasks can vary. To bridge this gap, we introduce Target-Aware Contrastive Learning (Target-aware CL) which aims to enhance target task performance by maximizing the mutual information between the target task and node representations with a self-supervised learning process. This is achieved through a sampling function, XGBoost Sampler (XGSampler), to sample proper positive examples for the proposed Target-Aware Contrastive Loss (XTCL). By minimizing XTCL, Target-aware CL increases the mutual information between the target task and node representations, such that model generalization is improved. Additionally, XGSampler enhances the interpretability of each signal by showing the weights for sampling the proper positive examples. We show experimentally that XTCL significantly improves the performance on two target tasks: node classification and link prediction tasks, compared to state-of-the-art models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。