arXiv:2508.05836cs.LG2025-08

用大模型增强文本图节点表示,提升学术网络分类效果

An Effective Approach for Node Classification in Textual Graphs

  • 用ChatGPT生成论文语义解释,融合进节点嵌入
  • 在ogbn-arxiv上达77.2%准确率,超越基线10%以上
  • 适合做学术知识图谱、科学发现等动态文本图任务

文本属性图(TAGs)对引文网络等复杂网络建模至关重要,但有效节点分类仍面临挑战,主要源于难以融合文本丰富语义与图结构信息。现有方法常受限于捕捉领域术语、建模长程依赖、适应时间演化及大规模数据扩展能力。为此,我们提出新框架,将TAPE(文本属性图表示增强)与Graphormer结合。该方法利用大语言模型ChatGPT在TAPE框架内生成论文内容的语义丰富解释,并将其融入增强节点表示;通过带学习注意力权重的新融合层,将这些表示与结构特征结合。Graphormer的路径感知位置编码和多头注意力机制有效捕捉引文网络中的长程依赖。我们在具有挑战性的ogbn-arxiv数据集上验证了该框架的有效性,实现77.2%的分类准确率,显著超过最佳GCN基线(71.3%)。同时在精确率(67.1%)、召回率(57.7%)和F1分数(61.0%)上表现优异。通过全面消融实验,量化各组件贡献,证实语义与结构信息的协同效应。该框架为动态文本属性图的节点分类提供了可扩展且稳健的解决方案,为知识系统与科学发现研究提供新方向。

原文摘要 · Abstract (English)

Textual Attribute Graphs (TAGs) are critical for modeling complex networks like citation networks, but effective node classification remains challenging due to difficulties in integrating rich semantics from text with structural graph information. Existing methods often struggle with capturing nuanced domain-specific terminology, modeling long-range dependencies, adapting to temporal evolution, and scaling to massive datasets. To address these issues, we propose a novel framework that integrates TAPE (Text-Attributed Graph Representation Enhancement) with Graphormer. Our approach leverages a large language model (LLM), specifically ChatGPT, within the TAPE framework to generate semantically rich explanations from paper content, which are then fused into enhanced node representations. These embeddings are combined with structural features using a novel integration layer with learned attention weights. Graphormer's path-aware position encoding and multi-head attention mechanisms are employed to effectively capture long-range dependencies across the citation network. We demonstrate the efficacy of our framework on the challenging ogbn-arxiv dataset, achieving state-of-the-art performance with a classification accuracy of 0.772, significantly surpassing the best GCN baseline of 0.713. Our method also yields strong results in precision (0.671), recall (0.577), and F1-score (0.610). We validate our approach through comprehensive ablation studies that quantify the contribution of each component, demonstrating the synergy between semantic and structural information. Our framework provides a scalable and robust solution for node classification in dynamic TAGs, offering a promising direction for future research in knowledge systems and scientific discovery.

节点分类文本图大模型Graphormer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。