通过增强文本与节点的匹配信号,提升文本图少样本分类准确率。
Hound: Hunting Supervision Signals for Few and Zero Shot Node Classification on Text-attributed Graph
- 设计节点扰动、文本匹配和语义否定三类增强方法,扩展监督信号。
- 在5个数据集上优于13个基线模型,性能提升超5%。
- 适合研究少样本/零样本图学习的学者,尤其关注跨模态对齐。
文本属性图(TAG)是一种包含节点文本描述的图结构数据,其少样本和零样本节点分类在学术与社交网络等领域有广泛应用。然而,由于缺乏足够的监督信号,该任务极具挑战性。现有方法仅使用对比损失对齐基于图的节点嵌入与基于语言的文本嵌入。本文提出Hound,通过引入更多监督信号来提升准确率,核心思想是超越数据中自带的节点-文本配对。具体设计三种增强技术:节点扰动通过增删边生成多样化的节点嵌入以匹配文本;文本匹配通过检索语义相似的文本来匹配节点;语义否定利用反向提示构建语义相反的负文本,与原节点和文本进行对比。我们在5个数据集上评估Hound,与13个先进基线比较,结果表明其持续优于所有基线,相比最佳基线准确率提升通常超过5%。
原文摘要 · Abstract (English)
Text-attributed graph (TAG) is an important type of graph structured data with text descriptions for each node. Few- and zero-shot node classification on TAGs have many applications in fields such as academia and social networks. However, the two tasks are challenging due to the lack of supervision signals, and existing methods only use the contrastive loss to align graph-based node embedding and language-based text embedding. In this paper, we propose Hound to improve accuracy by introducing more supervision signals, and the core idea is to go beyond the node-text pairs that come with data. Specifically, we design three augmentation techniques, i.e., node perturbation, text matching, and semantics negation to provide more reference nodes for each text and vice versa. Node perturbation adds/drops edges to produce diversified node embeddings that can be matched with a text. Text matching retrieves texts with similar embeddings to match with a node. Semantics negation uses a negative prompt to construct a negative text with the opposite semantics, which is contrasted with the original node and text. We evaluate Hound on 5 datasets and compare with 13 state-of-the-art baselines. The results show that Hound consistently outperforms all baselines, and its accuracy improvements over the best-performing baseline are usually over 5%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。