用类型驱动的多任务学习提升科学实体识别准确率
Enhancing Scientific Named Entity Recognition via Large Language Models: A Type-driven Multi-task Learning Approach
- 通过类型过滤模型精选候选实体类型,减少干扰
- 引入多任务学习框架,增强上下文表征能力
- 基于句义与类型多样性选择示范样本,激活大模型潜力
科学命名实体识别(SciNER)在科学文本的信息抽取与知识发现中至关重要。近期大语言模型(LLMs)已展现出以极低人工成本达到优异性能的能力。现有研究强调在提示中引入候选实体类型信息对提升识别准确性的重要性。然而,当提示中包含过多候选类型时,LLMs在复杂科学文本中的实体识别与标注能力会下降。为此,本文提出TdSciNER,一种类型驱动的方法,有效利用实体类型信息提升SciNER表现。首先设计实体类型过滤模型,识别句子中可能存在的最可能实体类型;其次,在多任务学习框架中引入辅助多分类实体类型任务,获取更丰富的上下文表示;最后,提出基于句意相似性与实体类型多样性的示范样本选择策略,激活大模型的上下文学习能力,从而提升跨科学领域的实体识别精度。在三个数据集上的实验表明,该方法性能接近全监督模型。进一步分析验证了每个类型驱动组件均对性能提升有贡献。本工作为科学文本挖掘中的命名实体识别及更广泛的信息抽取提供了重要启示。
原文摘要 · Abstract (English)
Scientific named entity recognition (SciNER) plays a crucial role in information extraction and knowledge discovery from scientific texts. Recently, large language models (LLMs) have demonstrated the capacity to achieve competitive SciNER performance with minimal human effort. Existing research highlights the importance of incorporating candidate entity type information for accurate entity recognition and classification by LLMs. However, when too many candidate entity types are provided in the prompt, LLMs struggle to accurately recognize and label entities in scientific texts, where entity types are more complex than in general domains. To address this challenge, we propose TdSciNER, a type-driven approach that effectively leverages entity type information to enhance SciNER performance. In TdSciNER, we first design an entity type filter model to identify the most likely entity types present in a given sentence. Subsequently, we introduce an auxiliary multi-class entity typing task within a multi-task learning framework alongside SciNER to obtain richer contextual representations. Then, we develop a novel demonstration selection strategy based on sentence similarity and entity type diversity to activate the in-context learning capabilities of LLMs, thereby improving entity recognition accuracy across diverse scientific domains. Experiments on three datasets demonstrate that our method achieves performance comparable to fully supervised models. Further analysis validates that each entity type-driven component in TdSciNER contributes to the improvement of SciNER performance. This work provides valuable insights for future advancements in SciNER and broader information extraction tasks in scientific text mining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。