构建中文农业实体识别权威数据集,覆盖27类实体。
AgriCHN: A Comprehensive Cross-domain Resource for Chinese Agricultural Named Entity Recognition
- 从农业文章中提取4040句,标注15799个实体
- 包含水文气象等跨领域实体,丰富度超现有资源
- 适合作为农业文本分析的基准数据集
农业命名实体识别旨在从大量文本中识别作物、病害、虫害、肥料等农业实体,对农业信息抽取至关重要。然而,高质量中文农业数据集稀缺,主流方法表现不佳。以往研究多聚焦农业实体,忽视其与水文、气象的深层关联。为此,我们提出AgriCHN,一个全面开放的中文农业命名实体识别资源。该数据集源自大量农业文章,共含4,040条句子,涵盖15,799个实体提及,涉及27种不同实体类别,且包含水文、气象等跨领域实体,显著提升实体多样性。数据验证表明,相比已有资源,AgriCHN在实体类型丰富性和细粒度划分上表现更优。我们还基于多个先进神经网络模型构建了基准任务,实验结果凸显其挑战性,具有重要研究价值。
原文摘要 · Abstract (English)
Agricultural named entity recognition is a specialized task focusing on identifying distinct agricultural entities within vast bodies of text, including crops, diseases, pests, and fertilizers. It plays a crucial role in enhancing information extraction from extensive agricultural text resources. However, the scarcity of high-quality agricultural datasets, particularly in Chinese, has resulted in suboptimal performance when employing mainstream methods for this purpose. Most earlier works only focus on annotating agricultural entities while overlook the profound correlation of agriculture with hydrology and meteorology. To fill this blank, we present AgriCHN, a comprehensive open-source Chinese resource designed to promote the accuracy of automated agricultural entity annotation. The AgriCHN dataset has been meticulously curated from a wealth of agricultural articles, comprising a total of 4,040 sentences and encapsulating 15,799 agricultural entity mentions spanning 27 diverse entity categories. Furthermore, it encompasses entities from hydrology to meteorology, thereby enriching the diversity of entities considered. Data validation reveals that, compared with relevant resources, AgriCHN demonstrates outstanding data quality, attributable to its richer agricultural entity types and more fine-grained entity divisions. A benchmark task has also been constructed using several state-of-the-art neural NER models. Extensive experimental results highlight the significant challenge posed by AgriCHN and its potential for further research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。