arXiv:2507.07405cs.LGcs.AI2025-07IJCAI被引 6

提出HGMP框架,让异构图模型更好适应多任务,提升性能。

HGMP:Heterogeneous Graph Multi-Task Prompt Learning

  • 将下游任务统一为图级格式,缓解预训练与任务不匹配问题。
  • 设计图级对比预训练策略,提升异构信息利用与多任务表现。
  • 引入异构特征提示,优化输入表示,适合多任务异构图场景。

预训练与微调方法在异构图神经网络领域受到广泛关注,因其可在预训练阶段利用大量无标签数据,学习丰富的结构特征。然而,这些方法存在预训练模型与下游任务不匹配的问题,导致某些应用场景下表现不佳。提示学习作为异构图任务的新方向,可通过灵活调整任务表示来解决目标不一致问题。本文提出一种新型异构图多任务提示学习框架HGMP。首先,将所有下游任务重新形式化为统一的图级任务格式,以弥合预训练模型与下游任务之间的差距。其次,针对现有图提示学习方法在异构图领域难以整合对比预训练策略的问题,设计了一种图级对比预训练策略,更有效地利用异构信息,提升多任务场景下的性能。最后,引入异构特征提示,通过优化输入图特征表示增强模型表现。在公开数据集上的实验结果表明,所提方法能良好适配多种任务,显著优于基线方法。

原文摘要 · Abstract (English)

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model to learn rich structural features. However, these methods face the issue of a mismatch between the pre-trained model and downstream tasks, leading to suboptimal performance in certain application scenarios. Prompt learning methods have emerged as a new direction in heterogeneous graph tasks, as they allow flexible adaptation of task representations to address target inconsistency. Building on this idea, this paper proposes a novel multi-task prompt framework for the heterogeneous graph domain, named HGMP. First, to bridge the gap between the pre-trained model and downstream tasks, we reformulate all downstream tasks into a unified graph-level task format. Next, we address the limitations of existing graph prompt learning methods, which struggle to integrate contrastive pre-training strategies in the heterogeneous graph domain. We design a graph-level contrastive pre-training strategy to better leverage heterogeneous information and enhance performance in multi-task scenarios. Finally, we introduce heterogeneous feature prompts, which enhance model performance by refining the representation of input graph features. Experimental results on public datasets show that our proposed method adapts well to various tasks and significantly outperforms baseline methods.

异构图提示学习多任务对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。