小数据下无监督多领域命名实体识别,提升模型泛化能力
Unsupervised Multidomain Approaches to Named Entity Recognition with Small Datasets
- 无监督预训练+迁移学习,解决小样本标注难题
- 在多个模拟小数据集上实现优于基线的识别准确率
- 适合资源匮乏领域的文本信息抽取应用
本文研究在无标签小规模数据条件下进行多领域命名实体识别(Multidomain Named Entity Recognition, NER)的挑战与方法。传统NER系统依赖大量标注数据,但在许多实际场景中难以获取。为此,本研究采用无监督预训练策略,在无标注数据上预先学习高质量表示,再结合迁移学习框架,在多个模拟小数据集上完成实体识别任务。针对领域差异大、数据稀疏和过拟合等问题,引入数据增强、少样本学习和领域对抗训练等技术。实验表明,该方法显著提升了模型在多样化、资源受限场景下的性能与泛化能力,为高效、可适应的自然语言处理应用提供新路径。
原文摘要 · Abstract (English)
This paper explores the challenges and the methodologies associated with learning quality representations in scenarios with unlabelled small or limited datasets for downstream information extraction task (Multidomain Named Entity Recognition (NER). The study adopts a Transfer Learning on small datasets. Traditional NER systems often rely on large, labelled data, which is impractical for many domains. This study, therefore, applies an unsupervised pre-training approach to precondition and identify entities without annotated datasets, then applies transfer learning models to different simulated limited datasets for a named entity recognition task. Entity Recognition (NER) is essential in natural language processing (NLP), it identifies and classifies related entities within the text. This study addresses the complexities of domain variability, data sparsity, and overfitting and investigates innovative approaches such as data augmentation, few-shot learning, and domain adversarial training. Integrating these techniques promises to enhance the performance and generalizability of NER systems across diverse and resource-constrained domains, paving the way for more efficient and adaptable NLP applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。