用大模型解决中文煤化工领域实体识别难题,提升少样本下的识别准确率。
LLM-DER:A Named Entity Recognition Method Based on Large Language Models for Chinese Coal Chemical Domain
- 利用大模型生成实体关系列表,扩充实体信息
- 通过合理性与一致性评估,过滤错误识别结果
- 在少样本下优于基线模型,适合复杂结构实体识别
领域特定命名实体识别(NER)旨在识别特定领域的实体及其类别,为构建领域知识图谱提供重要支持。当前深度学习方法虽广泛使用且有效,但依赖大规模标注数据,而特定领域标注数据稀缺限制了其应用。因此,研究者开始引入少样本方法并取得一定进展。然而,特定领域实体结构常较复杂,现有少样本方法难以适应具有复杂特征的NER任务。以中文煤化工领域为例,存在多个实体共享同一实体、同一对实体间存在多种关系等复杂结构,在样本稀少条件下严重影响识别效果。本文提出基于大语言模型(LLMs)的实体识别框架LLM-DER,通过大模型生成包含实体类型的实体关系列表以丰富实体信息,并设计合理性与一致性评估方法去除误识别实体,有效解决特定领域复杂结构实体识别问题。在Resume数据集和自建煤化工数据集Coal上的实验结果表明,LLM-DER在领域特定实体识别中表现优异,不仅优于现有GPT-3.5-turbo基线,还超越全监督基线,验证了其有效性。
原文摘要 · Abstract (English)
Domain-specific Named Entity Recognition (NER), whose goal is to recognize domain-specific entities and their categories, provides an important support for constructing domain knowledge graphs. Currently, deep learning-based methods are widely used and effective in NER tasks, but due to the reliance on large-scale labeled data. As a result, the scarcity of labeled data in a specific domain will limit its application.Therefore, many researches started to introduce few-shot methods and achieved some results. However, the entity structures in specific domains are often complex, and the current few-shot methods are difficult to adapt to NER tasks with complex features.Taking the Chinese coal chemical industry domain as an example,there exists a complex structure of multiple entities sharing a single entity, as well as multiple relationships for the same pair of entities, which affects the NER task under the sample less condition.In this paper, we propose a Large Language Models (LLMs)-based entity recognition framework LLM-DER for the domain-specific entity recognition problem in Chinese, which enriches the entity information by generating a list of relationships containing entity types through LLMs, and designing a plausibility and consistency evaluation method to remove misrecognized entities, which can effectively solve the complex structural entity recognition problem in a specific domain.The experimental results of this paper on the Resume dataset and the self-constructed coal chemical dataset Coal show that LLM-DER performs outstandingly in domain-specific entity recognition, not only outperforming the existing GPT-3.5-turbo baseline, but also exceeding the fully-supervised baseline, verifying its effectiveness in entity recognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。