用大模型生成语义丰富的少数类样本,提升长尾文本图的分类效果
SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs
- 利用大模型在文本层面进行插值,生成符合语义的合成样本
- 在多个基准数据集上显著超越传统数值插值和现有基线方法
- 结合图结构过滤噪声,适合处理含文本属性的长尾图数据
现实世界图数据常呈现长尾分布,导致图神经网络在头尾类别间泛化能力不足。近期邻域风险最小化(VRM)在缓解类别不平衡方面展现潜力,但现有方法多依赖嵌入空间算术,难以捕捉文本属性图中的丰富语义。本文提出SaVe-TAG(面向长尾文本属性图的语义感知邻域风险最小化),一种基于大语言模型的新型VRM框架,通过文本级插值生成位于流形上、边界增强的少数类合成样本。为降低生成噪声风险,引入基于置信度的边分配机制,利用图拓扑作为自然过滤器,确保结构一致性。我们提供了理论支持,并在多个基准数据集上进行了广泛实验,结果表明该方法持续优于数值插值及先前长尾节点分类基线。结果强调了融合语义与结构信号对平衡高效学习的重要性。源代码已公开:https://github.com/LWang-Laura/SaVe-TAG。
原文摘要 · Abstract (English)
Real-world graph data often follows long-tailed distributions, making it difficult for Graph Neural Networks (GNNs) to generalize well across both head and tail classes. Recent advances in Vicinal Risk Minimization (VRM) have shown promise in mitigating class imbalance with numeric interpolation; however, existing approaches largely rely on embedding-space arithmetic, which fails to capture the rich semantics inherent in text-attributed graphs. In this work, we propose our method, SaVe-TAG (Semantic-aware Vicinal Risk Minimization for Long-Tailed Text-Attributed Graphs), a novel VRM framework that leverages Large Language Models (LLMs) to perform text-level interpolation, generating on-manifold, boundary-enriching synthetic samples for minority classes. To mitigate the risk of noisy generation, we introduce a confidence-based edge assignment mechanism that uses graph topology as a natural filter to ensure structural consistency. We provide theoretical justification for our method and conduct extensive experiments on benchmark datasets, showing that our approach consistently outperforms both numeric interpolation and prior long-tailed node classification baselines. Our results highlight the importance of integrating semantic and structural signals for balanced and effective learning on text-attributed graphs. The source code is publicly available at: https://github.com/LWang-Laura/SaVe-TAG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。