新模型融合语法与语义,提升长句中实体关系抽取效果
Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences
- 引入实体感知自注意力和上下文图卷积网络,融合句法与语义信息
- 在多个数据集上超越现有依赖基与序列基模型,长句关系抽取表现突出
- 适合需要处理复杂长句关系抽取的NLP任务,如知识图谱构建
关系抽取是自然语言处理中的关键任务,旨在识别文本中命名实体之间的关系。近年来,基于依存树的图卷积网络被广泛用于捕捉句法特征并取得良好效果。然而,多数现有方法忽略了依存树外词语所携带的丰富有用信息。本文提出一种新模型——实体感知自注意力上下文图卷积网络(ESC-GCN),有效融合输入句子的句法结构与序列语义上下文。具体而言,相对位置自注意力捕获与词位置相关的整体语义关联,上下文图卷积网络通过充分剪枝操作捕捉词间的丰富句内依赖。此外,实体感知注意力层动态选择对最终关系预测更关键的标记。该模型不仅降低依存树噪声影响,还获取易被忽略的实体相关语义表示。大量实验表明,相比现有依赖基与序列基模型,本模型表现优异,尤其在长句中实体关系抽取方面优势明显。
原文摘要 · Abstract (English)
Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to capture syntactic features and achieved attractive performance. However, most existing dependency-based approaches ignore the positive influence of the words outside the dependency trees, sometimes conveying rich and useful information on relation extraction. In this paper, we propose a novel model, Entity-aware Self-attention Contextualized GCN (ESC-GCN), which efficiently incorporates syntactic structure of input sentences and semantic context of sequences. To be specific, relative position self-attention obtains the overall semantic pairwise correlation related to word position, and contextualized graph convolutional networks capture rich intra-sentence dependencies between words by adequately pruning operations. Furthermore, entity-aware attention layer dynamically selects which token is more decisive to make final relation prediction. In this way, our proposed model not only reduces the noisy impact from dependency trees, but also obtains easily-ignored entity-related semantic representation. Extensive experiments on various tasks demonstrate that our model achieves encouraging performance as compared to existing dependency-based and sequence-based models. Specially, our model excels in extracting relations between entities of long sentences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。