arXiv:2508.18090cs.DLcs.AI2025-08被引 4

用大模型零样本识别历史文本中的实体,突破标注数据匮乏瓶颈。

Named Entity Recognition of Historical Texts via Large Language Model

  • 采用零样本/少样本提示策略,无需大量标注数据
  • 在HIPE-2022数据集上达到可接受的识别性能
  • 适合古籍、档案等低资源历史文本信息提取

大型语言模型(LLMs)在自然语言处理任务中展现出强大泛化能力,尤其在命名实体识别(NER)方面表现突出。该任务旨在识别文本中的人名、组织名、地名、日期等专有名称,是结构化信息抽取的关键步骤。传统方法依赖大量标注数据,但历史文本因标注成本高、语言变异大(如拼写不一、古语词汇),导致标注数据稀缺。本研究探索了基于零样本和少样本提示的LLM在历史文本NER中的可行性。实验基于HIPE-2022(识别历史人物、地点及其他实体)数据集进行,结果显示,尽管性能仍低于全监督模型,但已具备合理表现。这表明,大模型为标注数据不足或具有历史价值的文本提供了高效可行的信息抽取方案。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated remarkable versatility across a wide range of natural language processing tasks and domains. One such task is Named Entity Recognition (NER), which involves identifying and classifying proper names in text, such as people, organizations, locations, dates, and other specific entities. NER plays a crucial role in extracting information from unstructured textual data, enabling downstream applications such as information retrieval from unstructured text. Traditionally, NER is addressed using supervised machine learning approaches, which require large amounts of annotated training data. However, historical texts present a unique challenge, as the annotated datasets are often scarce or nonexistent, due to the high cost and expertise required for manual labeling. In addition, the variability and noise inherent in historical language, such as inconsistent spelling and archaic vocabulary, further complicate the development of reliable NER systems for these sources. In this study, we explore the feasibility of applying LLMs to NER in historical documents using zero-shot and few-shot prompting strategies, which require little to no task-specific training data. Our experiments, conducted on the HIPE-2022 (Identifying Historical People, Places and other Entities) dataset, show that LLMs can achieve reasonably strong performance on NER tasks in this setting. While their performance falls short of fully supervised models trained on domain-specific annotations, the results are nevertheless promising. These findings suggest that LLMs offer a viable and efficient alternative for information extraction in low-resource or historically significant corpora, where traditional supervised methods are infeasible.

命名实体识别历史文本大模型零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。