用位置注意力提升BERT命名实体识别效率，降低训练成本。
Positional Attention for Efficient BERT-Based Named Entity Recognition
- 引入位置注意力机制，优化BERT在实体识别中的特征提取
- 在Kaggle数据集上少训练几轮即达高准确率
- 适合需要快速部署、资源受限的实体识别场景
本文提出一种基于BERT的命名实体识别框架，通过引入位置注意力机制，在保持高精度的同时显著降低训练成本。尽管BERT在实体识别任务中表现优异，但针对每个新应用从头微调仍存在计算开销大、耗时长的问题。本方法利用预训练参数，结合位置注意力实现高效定制化。在源自格罗宁根意义库语料库的Kaggle数据集上验证，仅需较少训练轮次即可取得优异性能，为降低BERT-based NER系统的训练成本提供了实用解决方案。
原文摘要 · Abstract (English)
This paper presents a framework for Named Entity Recognition (NER) leveraging the Bidirectional Encoder Representations from Transformers (BERT) model in natural language processing (NLP). NER is a fundamental task in NLP with broad applicability across downstream applications. While BERT has established itself as a state-of-the-art model for entity recognition, fine-tuning it from scratch for each new application is computationally expensive and time-consuming. To address this, we propose a cost-efficient approach that integrates positional attention mechanisms into the entity recognition process and enables effective customization using pre-trained parameters. The framework is evaluated on a Kaggle dataset derived from the Groningen Meaning Bank corpus and achieves strong performance with fewer training epochs. This work contributes to the field by offering a practical solution for reducing the training cost of BERT-based NER systems while maintaining high accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。