arXiv:2512.13884cs.CL2025-12Conference of the …

构建91语言的多语种命名实体识别数据集,用大模型自动生成高质量标注。

FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition

  • 用回归模型筛选文本片段,结合多语大模型自动标注实体。
  • 生成22.5万条带标签的文本,19倍少数据下性能媲美或超越基线。
  • 支持中英文双标签,避免语言转换导致性能下降0.02~0.09 F1。

近期多语种命名实体识别研究显示,大语言模型可提供有效的合成监督,但此类数据集多为实验副产品,缺乏系统性与可复用性。本文提出FiNERweb,一个可扩展至91种语言和25种文字的自动化数据构建流水线。基于FineWeb-Edu,该方法训练回归模型以识别与命名实体相关的文本段落,并由多语大模型进行标注,最终生成约22.5万条文本片段,包含23.5万个不同实体标签。实验表明,回归模型F1超过84,使用FiNERweb训练的模型在英语、泰语和斯瓦希里语的零样本迁移任务中表现相当或更优,尽管训练数据仅为强基线的1/19。通过大模型作为评判者评估标注质量,忠实度(3.99/5)和完整性(4.05/5)均较高,说明标注可靠且信息丰富。此外,我们发布包含英文标签及目标语言翻译标签的数据集,因发现当前最优模型在使用目标语言标签时性能下降0.02至0.09 F1。FiNERweb及其所有配套资源已公开,旨在推动多语种命名实体识别中的师生训练范式发展。

原文摘要 · Abstract (English)

Recent multilingual named entity recognition (NER) work has shown that large language models (LLMs) can provide effective synthetic supervision, yet such datasets have mostly appeared as by-products of broader experiments rather than as systematic, reusable resources. We introduce FiNERweb, a dataset-creation pipeline that scales the teacher-student paradigm to 91 languages and 25 scripts. Building on FineWeb-Edu, our approach trains regression models to identify NER-relevant passages and annotates them with multilingual LLMs, resulting in about 225k passages with 235k distinct entity labels. Our experiments show that the regression model achieves more than 84 F1, and that models trained on FiNERweb obtain comparable or improved performance in zero shot transfer settings on English, Thai, and Swahili, despite being trained on 19x less data than strong baselines. In addition, we assess annotation quality using LLM-as-a-judge and observe consistently high scores for both faithfulness (3.99 out of 5) and completeness (4.05 out of 5), indicating reliable and informative annotations. Further, we release the dataset with both English labels and translated label sets in the respective target languages because we observe that the performance of current state-of-the-art models drops by 0.02 to 0.09 F1 when evaluated using target language labels instead of English ones. We release FiNERweb together with all accompanying artifacts to the research community in order to facilitate more effective student-teacher training for multilingual named entity recognition.

命名实体识别多语言数据集自动生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。