arXiv:2409.10294cs.CLcs.AI2024-09被引 5

提出多粒度图结构注意力,同时捕捉实体与词语级关系,提升知识图谱转文本质量。

MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generation

  • 设计双粒度编码:分别建模实体间和词语间结构关系
  • 在WebNLG和EventNarrative上超越单粒度模型,显著提升生成文本质量
  • 适合需要精准理解图谱结构的自然语言生成任务

知识图谱到文本生成任务旨在将结构化的知识图谱转化为连贯且可读的自然语言。近期研究通过引入图结构信息增强预训练语言模型(PLMs),以捕捉知识图谱的复杂结构细节。然而,多数方法仅关注单一粒度的结构信息,或聚焦实体间的原始关系,或关注同一实体内或跨实体的词语间关系。这种局限导致仅关注实体层级的模型忽略词语间的细微语义关系,而仅关注词级结构的模型则忽视原始实体的整体关系。为此,本文提出多粒度图结构注意力(MGSA),基于PLMs构建模型架构。其编码器包含实体级结构编码模块、词级结构编码模块及融合两者信息的聚合模块。该多粒度编码方式使模型能同时捕获实体级与词级结构信息,从而更全面地理解知识图谱的结构,显著提升生成文本质量。我们在WebNLG和EventNarrative两个主流基准数据集上进行了广泛评估,结果表明MGSA始终优于仅依赖单粒度结构信息的模型,验证了该方法的有效性。

原文摘要 · Abstract (English)

The Knowledge Graph-to-Text Generation task aims to convert structured knowledge graphs into coherent and human-readable natural language text. Recent efforts in this field have focused on enhancing pre-trained language models (PLMs) by incorporating graph structure information to capture the intricate structure details of knowledge graphs. However, most of these approaches tend to capture only single-granularity structure information, concentrating either on the relationships between entities within the original graph or on the relationships between words within the same entity or across different entities. This narrow focus results in a significant limitation: models that concentrate solely on entity-level structure fail to capture the nuanced semantic relationships between words, while those that focus only on word-level structure overlook the broader relationships between original entire entities. To overcome these limitations, this paper introduces the Multi-granularity Graph Structure Attention (MGSA), which is based on PLMs. The encoder of the model architecture features an entity-level structure encoding module, a word-level structure encoding module, and an aggregation module that synthesizes information from both structure. This multi-granularity structure encoding approach allows the model to simultaneously capture both entity-level and word-level structure information, providing a more comprehensive understanding of the knowledge graph's structure information, thereby significantly improving the quality of the generated text. We conducted extensive evaluations of the MGSA model using two widely recognized KG-to-Text Generation benchmark datasets, WebNLG and EventNarrative, where it consistently outperformed models that rely solely on single-granularity structure information, demonstrating the effectiveness of our approach.

知识图谱文本生成图神经网络多粒度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。