提出新模型解决生物医学实体片段分离识别难题
GapDNER: A Gap-Aware Grid Tagging Model for Discontinuous Named Entity Recognition
- 将实体间隙当作特殊跨度,转为成对标记任务
- 在三个数据集上达到当前最好效果,尤其擅长复杂结构
- 适合处理重叠或不连续的生物医学命名实体
在生物医学领域,命名实体可能由多个非相邻词元组成,并与其他实体重叠。以往方法通过连接实体片段或内部词元进行识别,但面临错误传播和解码歧义问题,因跨度或词元组合多样。为此,我们深入分析不连续实体结构,提出一种新型的间隙感知网格标注模型——GapDNER。该模型创新性地对实体片段间的上下文间隙进行表示学习,以缓解解码歧义并提升性能。具体地,将上下文间隙视为额外跨度类型,将跨度分类转化为词元对网格标注任务;设计两个交互模块:跨跨度关系增强模块利用交叉注意力捕捉不同跨度间的语义关联,段内规律提取模块结合双仿射机制与线性注意力捕捉每个跨度内部规律。推理阶段,为每个实体片段和间隙分配有向边,采用广度优先搜索(BFS)算法在带标签网格中寻找所有有效路径。实验在三个数据集上验证,结果表明GapDNER在不连续命名实体识别上达到新的最优水平,尤其在复杂实体结构识别上表现突出。
原文摘要 · Abstract (English)
In biomedical fields, one named entity may consist of a series of non-adjacent tokens and overlap with other entities. Previous methods recognize discontinuous entities by connecting entity fragments or internal tokens, which face challenges of error propagation and decoding ambiguity due to the wide variety of span or word combinations. To address these issues, we deeply explore discontinuous entity structures and propose an effective Gap-aware grid tagging model for Discontinuous Named Entity Recognition, named GapDNER. Our GapDNER innovatively applies representation learning on the context gaps between entity fragments to resolve decoding ambiguity and enhance discontinuous NER performance. Specifically, we treat the context gap as an additional type of span and convert span classification into a token-pair grid tagging task. Subsequently, we design two interactive components to comprehensively model token-pair grid features from both intra- and inter-span perspectives. The intra-span regularity extraction module employs the biaffine mechanism along with linear attention to capture the internal regularity of each span, while the inter-span relation enhancement module utilizes criss-cross attention to obtain semantic relations among different spans. At the inference stage of entity decoding, we assign a directed edge to each entity fragment and context gap, then use the BFS algorithm to search for all valid paths from the head to tail of grids with entity tags. Experimental results on three datasets demonstrate that our GapDNER achieves new state-of-the-art performance on discontinuous NER and exhibits remarkable advantages in recognizing complex entity structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。