无需标注数据,用文本生成模拟节点实现零样本图分类。
Prompt Tuning without Labeled Samples for Zero-Shot Node Classification in Text-Attributed Graphs
- 用图文联合生成器根据类别名合成节点与文本嵌入。
- 在多个基准数据集上超越现有最优方法,零样本准确率提升显著。
- 适合无标注数据的图神经网络应用,如社交网络分类。
节点分类是信息检索中的基础问题,在社交网络社区发现、在线文章分组和电商商品分类等场景中广泛应用。文本属性图(TAGs)中的零样本节点分类面临巨大挑战,尤其因缺乏标注数据。本文提出一种新型零样本提示调优框架(ZPT),利用通用双模态条件生成器(UBCG)解决该问题。首先预训练图-语言模型以捕捉节点的图结构与文本描述;随后训练条件生成模型,学习图与文本模态的联合分布,仅凭类别名即可生成各类别的合成样本。这些合成节点与文本嵌入用于连续提示调优,实现零样本有效分类。我们在多个基准数据集上进行大量实验,结果表明本框架优于现有最先进方法。消融实验验证了双模态生成器的有效性。代码已开源:https://github.com/Sethup123/ZPT。
原文摘要 · Abstract (English)
Node classification is a fundamental problem in information retrieval with many real-world applications, such as community detection in social networks, grouping articles published online and product categorization in e-commerce. Zero-shot node classification in text-attributed graphs (TAGs) presents a significant challenge, particularly due to the absence of labeled data. In this paper, we propose a novel Zero-shot Prompt Tuning (ZPT) framework to address this problem by leveraging a Universal Bimodal Conditional Generator (UBCG). Our approach begins with pre-training a graph-language model to capture both the graph structure and the associated textual descriptions of each node. Following this, a conditional generative model is trained to learn the joint distribution of nodes in both graph and text modalities, enabling the generation of synthetic samples for each class based solely on the class name. These synthetic node and text embeddings are subsequently used to perform continuous prompt tuning, facilitating effective node classification in a zero-shot setting. Furthermore, we conduct extensive experiments on multiple benchmark datasets, demonstrating that our framework performs better than existing state-of-the-art baselines. We also provide ablation studies to validate the contribution of the bimodal generator. The code is provided at: https://github.com/Sethup123/ZPT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。