arXiv:2411.00533cs.CLcs.AI2024-11被引 1

用反向生成法构建实体示例库,提升大模型零样本命名实体识别能力

ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models

  • 通过逆向生成实体定义对应的句子,构建高质量示例库
  • 在无标注数据场景下,性能显著超越现有零样本NER方法
  • 适合缺乏标注数据的领域应用,且计算开销更低

本文提出ReverseNER,一种克服大模型在零样本命名实体识别(NER)中依赖预设示例局限性的方法。该方法通过逆向过程构建可靠示例库:先利用大模型根据实体定义生成实体,再将其扩展为完整句子。扩展过程中,借鉴从任务句中聚类提取的特定结构句,生成数十条与任务相关的实体标注句。构建示例库后,为每个任务句选择若干语义相近的标注示例作为参考,辅助大模型识别。此外,提出基于实体级别的自一致性评分机制以进一步提升性能。实验表明,ReverseNER在无标注数据场景下显著优于其他基于大模型的零样本NER方法,同时降低计算资源消耗。

原文摘要 · Abstract (English)

This paper presents ReverseNER, a method aimed at overcoming the limitation of large language models (LLMs) in zero-shot named entity recognition (NER) tasks, arising from their reliance on pre-provided demonstrations. ReverseNER tackles this challenge by constructing a reliable example library composed of dozens of entity-labeled sentences, generated through the reverse process of NER. Specifically, while conventional NER methods label entities in a sentence, ReverseNER features reversing the process by using an LLM to generate entities from their definitions and subsequently expand them into full sentences. During the entity expansion process, the LLM is guided to generate sentences by replicating the structures of a set of specific \textsl{feature sentences}, extracted from the task sentences by clustering. This expansion process produces dozens of entity-labeled task-relevant sentences. After constructing the example library, the method selects several semantically similar entity-labeled examples for each task sentence as references to facilitate the LLM's entity recognition. We also propose an entity-level self-consistency scoring mechanism to improve NER performance with LLMs. Experiments show that ReverseNER significantly outperforms other zero-shot NER methods with LLMs, marking a notable improvement in NER for domains without labeled data, while declining computational resource consumption.

零样本学习命名实体识别大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。