arXiv:2504.02064cs.CLcs.AI2025-04被引 1

将文本转为图结构,用图神经网络提升NLP模型可解释性

From Text to Graph: Leveraging Graph Neural Networks for Enhanced Explainability in NLP

  • 把句子自动转成含语义节点和关系的图结构
  • 在分类任务中准确识别影响结果的关键文本成分
  • 适合需要理解模型决策过程的研究者与开发者

自然语言处理长期依赖Transformer类模型,尤其在生成与分类任务中表现优异。随着模型规模增大,性能显著提升,但其可解释性面临挑战:计算开销大,且基于分词的处理方式破坏了词语的原始语义。本文提出一种新方法,将文本自动转换为图结构,通过节点和边保留基本语言概念的语义信息。该图结构支持后续任务中的知识利用,帮助揭示模型如何关联文本元素与预测结果。实验表明,该方法能有效识别分类任务中最重要的文本构成部分,具备良好的可解释性能力。

原文摘要 · Abstract (English)

Researchers have relegated natural language processing tasks to Transformer-type models, particularly generative models, because these models exhibit high versatility when performing generation and classification tasks. As the size of these models increases, they achieve outstanding results. Given their widespread use, many explainability techniques are developed based on these models. However, this process becomes computationally expensive due to the large size of the models. Additionally, transformers interpret input information through tokens that fragment input words into sequences lacking inherent semantic meaning, complicating the explanation of the model from the very beginning. This study proposes a novel methodology to achieve explainability in natural language processing tasks by automatically converting sentences into graphs and maintaining semantics through nodes and relations that express fundamental linguistic concepts. It also allows the subsequent exploitation of this knowledge in subsequent tasks, making it possible to obtain trends and understand how the model associates the different elements inside the text with the explained task. The experiments delivered promising results in determining the most critical components within the text structure for a given classification.

可解释性图神经网络NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。