arXiv:2502.08918cs.LG2025-02KDD

提出基于聚类的图提示学习方法,提升异构图下游任务性能

CLEAR: Cluster-based Prompt Learning on Heterogeneous Graphs

  • 用聚类提示重构异构图,统一预训练与下游任务目标
  • 在节点分类任务中最高提升5% F1得分,优于现有模型
  • 融合元路径高阶语义,适合异构图表示学习研究者

提示学习在图领域受到越来越多关注,旨在弥合预训练任务与下游任务之间的差距。现有的异构图提示学习方法通常使用特征提示修改节点特征以适应特定下游任务,但忽略了异构图的结构信息,也未充分利用元路径所蕴含的高阶语义。为此,我们提出CLEAR——一种基于聚类的异构图提示学习模型。通过引入聚类提示,将下游任务重新表述为异构图重建任务,使预训练与下游任务共享相同的训练目标。同时,聚类提示被注入到元路径中,使提示学习过程能够融入元路径所携带的高阶语义信息。大量实验表明,CLEAR在下游任务上表现优越,持续超越现有最优模型,在节点分类任务中F1指标最高提升5%。

原文摘要 · Abstract (English)

Prompt learning has attracted increasing attention in the graph domain as a means to bridge the gap between pretext and downstream tasks. Existing studies on heterogeneous graph prompting typically use feature prompts to modify node features for specific downstream tasks, which do not concern the structure of heterogeneous graphs. Such a design also overlooks information from the meta-paths, which are core to learning the high-order semantics of the heterogeneous graphs. To address these issues, we propose CLEAR, a Cluster-based prompt LEARNING model on heterogeneous graphs. We present cluster prompts that reformulate downstream tasks as heterogeneous graph reconstruction. In this way, we align the pretext and downstream tasks to share the same training objective. Additionally, our cluster prompts are also injected into the meta-paths such that the prompt learning process incorporates high-order semantic information entailed by the meta-paths. Extensive experiments on downstream tasks confirm the superiority of CLEAR. It consistently outperforms state-of-the-art models, achieving up to 5% improvement on the F1 metric for node classification.

图神经网络提示学习异构图元路径

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。