arXiv:2512.20097cs.CL2025-12

新模型融合图与序列信息,提升文本分类准确率

A Novel Graph-Sequence Learning Model for Inductive Text Classification

  • 构建多关系文本图,用不同边类型表示词间语义、句法等关系
  • 引入自适应多边消息传递机制,更好聚合复杂结构信息
  • 结合Transformer捕捉序列特征,支持新词新关系的归纳分类

文本分类在情感分析、虚假新闻检测和舆论分析等任务中至关重要。近年来,基于图神经网络(GNN)的方法因擅长学习结构关系而取得显著进展,但仍存在两大局限:一是未能充分建模词对间的多样化结构信息(如共现、句法、语义);二是忽视了文本图结构中的序列信息,难以处理含新词或新关系的文本。为此,本文提出一种新型图-序列学习模型TextGSL,用于归纳式文本分类。具体地,为每篇文本构建单个词级图,并根据词对间多样关系定义不同边类型;在此基础上设计自适应多边消息传递机制,以聚合多种结构信息;同时通过引入Transformer层捕捉文本序列信息。实验在多个基准数据集上验证,TextGSL在分类准确率上优于多个强基线模型。

原文摘要 · Abstract (English)

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made significant progress due to their strong capabilities of structural relationship learning. However, these approaches still face two major limitations. First, these approaches fail to fully consider the diverse structural information across word pairs, e.g., co-occurrence, syntax, and semantics. Furthermore, they neglect sequence information in the text graph structure information learning module and can not classify texts with new words and relations. In this paper, we propose a Novel Graph-Sequence Learning Model for Inductive Text Classification (TextGSL) to address the previously mentioned issues. More specifically, we construct a single text-level graph for all words in each text and establish different edge types based on the diverse relationships between word pairs. Building upon this, we design an adaptive multi-edge message-passing paradigm to aggregate diverse structural information between word pairs. Additionally, sequential information among text data can be captured by the proposed TextGSL through the incorporation of Transformer layers. Therefore, TextGSL can learn more discriminative text representations. TextGSL has been comprehensively compared with several strong baselines. The experimental results on diverse benchmarking datasets demonstrate that TextGSL outperforms these baselines in terms of accuracy.

文本分类图神经网络序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。