arXiv:2510.17720cs.CLcs.AI2025-10被引 1

用改写上下文的方法,让少数据也能做精准实体识别

PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition

  • 用简化指令模板+上下文改写,提升大模型在少量标注数据下的表现
  • 在CrossNER数据集上少样本F1达80.1,比基线最高提升17分
  • 适合标注数据少、算力有限的团队快速部署实体识别系统

命名实体识别(NER)需要大量标注数据,在低资源场景下因标签获取成本高而困难。尽管零样本和指令微调方法有所进展,但常无法泛化到领域特定实体,且未有效利用有限数据。我们提出一种轻量级少样本NER框架,包含两项关键创新:(1) 设计新型指令微调模板,采用简化输出格式,结合前期方法优势,充分利用最新大模型的大上下文窗口;(2) 引入有策略的数据增强技术,在保持实体信息的同时对上下文进行改写,扩大训练数据而不破坏语义关系。在基准数据集上的实验表明,该方法在少样本和零样本任务中表现接近顶尖模型,其少样本方案在CrossNER数据集上平均F1达80.1。使用该改写方法训练的模型相比基线版本F1提升高达17分,为标注数据与算力均有限的群体提供了有效解决方案。

原文摘要 · Abstract (English)

Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made progress, they often fail to generalize to domain-specific entities and do not effectively utilize limited available data. We present a lightweight few-shot NER framework that addresses these challenges through two key innovations: (1) a new instruction tuning template with a simplified output format that combines principles from prior IT approaches to leverage the large context window of recent state-of-the-art LLMs; (2) introducing a strategic data augmentation technique that preserves entity information while paraphrasing the surrounding context, thereby expanding our training data without compromising semantic relationships. Experiments on benchmark datasets show that our method achieves performance comparable to state-of-the-art models on few-shot and zero-shot tasks, with our few-shot approach attaining an average F1 score of 80.1 on the CrossNER datasets. Models trained with our paraphrasing approach show consistent improvements in F1 scores of up to 17 points over baseline versions, offering a promising solution for groups with limited NER training data and compute power.

命名实体识别少样本学习数据增强大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。