arXiv:2503.15737cs.CL2025-03被引 5

用知识图谱增强医学实体识别,提升模型准确率

KoGNER: A Novel Framework for Knowledge Graph Distillation on Biomedical Named Entity Recognition

  • 将知识图谱信息提炼为轻量表示,融入实体识别模型
  • 在多个基准数据集上超越微调模型和大模型性能
  • 适合需要高精度医学实体抽取的研究与应用

命名实体识别(NER)是自然语言处理中的基础任务,在信息抽取、问答系统和知识驱动系统中至关重要。传统深度学习模型在领域泛化能力差且面临数据稀疏问题。本文提出知识图谱蒸馏用于命名实体识别(KoGNER),通过将知识图谱(KG)的结构化知识融入NER模型,丰富上下文嵌入,提升实体分类准确性并降低检测歧义。该框架采用两步策略:(1)知识蒸馏,将外部知识源压缩为轻量表示以无缝集成至NER模型;(2)实体感知增强,将融合知识图谱信息的上下文嵌入直接注入图神经网络(GNN),增强模型对实体关系的理解。在多个基准数据集上的实验表明,KoGNER性能达到当前最优,显著优于微调的NER模型和大语言模型(LLMs)。结果表明,利用知识图谱作为辅助信息可显著提升NER准确率,为知识感知NLP研究提供了新方向。

原文摘要 · Abstract (English)

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that plays a crucial role in information extraction, question answering, and knowledge-based systems. Traditional deep learning-based NER models often struggle with domain-specific generalization and suffer from data sparsity issues. In this work, we introduce Knowledge Graph distilled for Named Entity Recognition (KoGNER), a novel approach that integrates Knowledge Graph (KG) distillation into NER models to enhance entity recognition performance. Our framework leverages structured knowledge representations from KGs to enrich contextual embeddings, thereby improving entity classification and reducing ambiguity in entity detection. KoGNER employs a two-step process: (1) Knowledge Distillation, where external knowledge sources are distilled into a lightweight representation for seamless integration with NER models, and (2) Entity-Aware Augmentation, which integrates contextual embeddings that have been enriched with knowledge graph information directly into GNN, thereby improving the model's ability to understand and represent entity relationships. Experimental results on benchmark datasets demonstrate that KoGNER achieves state-of-the-art performance, outperforming finetuned NER models and LLMs by a significant margin. These findings suggest that leveraging knowledge graphs as auxiliary information can significantly improve NER accuracy, making KoGNER a promising direction for future research in knowledge-aware NLP.

知识图谱实体识别医学NLP图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。