用大模型提升医疗文本细粒度实体识别,效果远超传统方法。
Beyond the Basics: Leveraging Large Language Model for Fine-Grained Medical Entity Recognition

- 基于LLaMA3模型,采用微调+低秩适配优化识别能力。
- 细粒度识别F1达81.24%,比零样本高63.11%。
- 适合临床信息提取、电子病历分析等实际场景使用。
从入院记录、出院小结等非结构化医疗文本中提取临床相关资讯仍是临床自然语言处理的难点。医学实体识别(MER)旨在识别这些记录中的有意义概念。尽管大语言模型(LLMs)在MER上表现优异,但现有评估多集中于通用实体类型,难以满足需要细粒度提取的真实临床需求。为此,我们系统评估了开源模型LLaMA3在18种临床详细类别上的细粒度医疗实体识别性能。通过零样本、少样本及使用低秩适配(LoRA)的微调三种学习范式优化性能,并引入基于词元和句子级嵌入相似性的两种示例选择方法,利用预训练的BioBERT模型提升少样本学习效果。与以往在专有模型(如GPT-4)或不同架构上进行评估的研究不同,本研究统一以LLaMA3为基座,确保方法可比性。结果表明,微调后的LLaMA3在细粒度识别上相比零样本和少样本分别提升63.11%和35.63%,达到F1分数81.24%。
原文摘要 · Abstract (English)
Extracting clinically relevant information from unstructured medical narratives such as admission notes, discharge summaries, and emergency case histories remains a challenge in clinical natural language processing (NLP). Medical Entity Recognition (MER) identifies meaningful concepts embedded in these records. Recent advancements in large language models (LLMs) have shown competitive MER performance; however, evaluations often focus on general entity types, offering limited utility for real-world clinical needs requiring finer-grained extraction. To address this gap, we rigorously evaluated the open-source LLaMA3 model for fine-grained medical entity recognition across 18 clinically detailed categories. To optimize performance, we employed three learning paradigms: zero-shot, few-shot, and fine-tuning with Low-Rank Adaptation (LoRA). To further enhance few-shot learning, we introduced two example selection methods based on token- and sentence-level embedding similarity, utilizing a pre-trained BioBERT model. Unlike prior work assessing zero-shot and few-shot performance on proprietary models (e.g., GPT-4) or fine-tuning different architectures, we ensured methodological consistency by applying all strategies to a unified LLaMA3 backbone, enabling fair comparison across learning settings. Our results showed that fine-tuned LLaMA3 surpasses zero-shot and few-shot approaches by 63.11% and 35.63%, respectivel respectively, achieving an F1 score of 81.24% in granular medical entity extraction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。