用大模型统一解决生物医学实体识别中的嵌套与跨语言难题
A Unified Biomedical Named Entity Recognition Framework with Large Language Models
- 将实体识别转为文本生成任务,符号化标注兼顾平铺与嵌套实体
- 在四个基准数据集上达到最新性能,零样本跨语言泛化能力强
- 适合需要高精度实体抽取的医学AI研究者和开发者
准确识别生物医学命名实体对医疗信息提取与知识发现至关重要。现有方法常面临嵌套实体、边界模糊及跨语言泛化困难等问题。本文提出一种基于大语言模型的统一生物医学命名实体识别框架(LLMNER)。将BioNER重构为文本生成任务,设计符号化标注策略,显式标注边界以联合处理平铺与嵌套实体。为增强多语言与多任务泛化能力,在多个中英文数据集上进行双语联合微调。此外,引入基于对比学习的实体选择器,利用边界敏感的正负样本过滤错误或冗余预测。在四个基准数据集及两个未见语料上的实验表明,该方法实现最先进性能,并具备强零样本跨语言泛化能力。源码已开源:https://github.com/dreamer-tx/LLMNER。
原文摘要 · Abstract (English)
Accurate recognition of biomedical named entities is critical for medical information extraction and knowledge discovery. However, existing methods often struggle with nested entities, entity boundary ambiguity, and cross-lingual generalization. In this paper, we propose a unified Biomedical Named Entity Recognition (BioNER) framework based on Large Language Models (LLMs). We first reformulate BioNER as a text generation task and design a symbolic tagging strategy to jointly handle both flat and nested entities with explicit boundary annotation. To enhance multilingual and multi-task generalization, we perform bilingual joint fine-tuning across multiple Chinese and English datasets. Additionally, we introduce a contrastive learning-based entity selector that filters incorrect or spurious predictions by leveraging boundary-sensitive positive and negative samples. Experimental results on four benchmark datasets and two unseen corpora show that our method achieves state-of-the-art performance and robust zero-shot generalization across languages. The source codes are freely available at https://github.com/dreamer-tx/LLMNER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。