arXiv:2412.10858cs.CLcs.IR2024-12

通过建模汉字间关系提升中文命名实体识别准确率

CRENER: A Character Relation Enhanced Chinese NER Model

  • 将中文命名实体识别转化为字符间关系分类任务
  • 在四个基准数据集上均超越现有最佳模型
  • 适合需要高精度中文实体识别的研究与应用

中文命名实体识别是信息抽取中的关键任务,对下游应用具有重要影响。由于中文缺乏自然分隔符,以往方法多依赖外部词典来增强词语的语义和边界信息,但可能引入噪声,影响识别准确率。为此,本文提出字符关系增强的中文命名实体识别模型(CRENER)。该模型定义了四类反映字符间关系的标签,基于相邻关系、字符-标签关系及标签间关系三种类型,对字符间细粒度关系进行建模,更精准地识别实体边界,提升中文命名实体识别性能。具体而言,将中文命名实体识别任务转化为字符-字符关系分类任务,通过联合建模关系标签确保实体边界的准确性。为增强上下文理解能力,构建了结合无缩放方向感知与距离感知掩码自注意力机制的改进Transformer编码器。此外,设计了关系表示增强模块,有效挖掘字符与标签之间的关系表示。在四个知名中文命名实体识别基准数据集上的实验表明,所提模型优于当前最优基线。消融实验进一步验证了模型的有效性。

原文摘要 · Abstract (English)

Chinese Named Entity Recognition (NER) is an important task in information extraction, which has a significant impact on downstream applications. Due to the lack of natural separators in Chinese, previous NER methods mostly relied on external dictionaries to enrich the semantic and boundary information of Chinese words. However, such methods may introduce noise that affects the accuracy of named entity recognition. To this end, we propose a character relation enhanced Chinese NER model (CRENER). This model defines four types of tags that reflect the relationships between characters, and proposes a fine-grained modeling of the relationships between characters based on three types of relationships: adjacency relations between characters, relations between characters and tags, and relations between tags, to more accurately identify entity boundaries and improve Chinese NER accuracy. Specifically, we transform the Chinese NER task into a character-character relationship classification task, ensuring the accuracy of entity boundary recognition through joint modeling of relation tags. To enhance the model's ability to understand contextual information, WRENER further constructed an adapted transformer encoder that combines unscaled direction-aware and distance-aware masked self-attention mechanisms. Moreover, a relationship representation enhancement module was constructed to model predefined relationship tags, effectively mining the relationship representations between characters and tags. Experiments conducted on four well-known Chinese NER benchmark datasets have shown that the proposed model outperforms state-of-the-art baselines. The ablation experiment also demonstrated the effectiveness of the proposed model.

中文NER字符关系序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。