arXiv:2605.04489cs.CEcs.AI2026-05

用规则+模型混合方法,提升越南语低资源实体识别准确率

A Hybrid Method for Low-Resource Named Entity Recognition

  • 先用规则合并标签降复杂度,再用预训练模型精炼提取
  • 在5个领域数据集上,最高提升14个百分点(36%→60%)
  • 适合低资源语言、小样本场景下的命名实体识别任务

命名实体识别(NER)是自然语言处理的核心组件,在信息抽取和对话AI中应用广泛。然而,针对低资源语言的特定领域NER面临标注数据少、标签体系不统一等问题。本文提出一种混合神经符号框架,结合规则与深度学习模型用于越南语NER。核心思路为两阶段流程:首先通过规则组件将关系类和特殊类别合并,降低标签复杂度;其次对预训练语言模型进行微调以实现高精度提取;最后通过后处理模块恢复细粒度标签,保持应用可用性。为缓解数据稀缺问题,引入基于大语言模型(LLMs)的可扩展数据增强策略,无需全量重新标注即可扩充标签集,这是本文的重要创新。在物流、野生动物、医疗等五个特定领域数据集上评估,实验结果表明,该方法显著优于强基线模型:客户客服领域F1达90%(原83%),GAM领域84%(原73%),AI Fluent领域83%(原80%),PhoNER_Covid19领域94%(原91%),稀有野生动物领域60%(原36%)。结果验证了该混合方法能有效捕捉越南语的语言复杂性和专业领域的上下文特征,为低资源NER研究提供稳健方案。

原文摘要 · Abstract (English)

Named Entity Recognition (NER) is a critical component of Natural Language Processing with diverse applications in information extraction and conversational AI. However, NER in specific domains for low-resource languages faces challenges such as limited annotated data and heterogeneous label sets. This study addresses these issues by proposing a hybrid neurosymbolic framework that integrates rule-based processing with deep learning models for Vietnamese NER. The core idea involves a two-stage pipeline: first, a rule-based component reduces label complexity by grouping relational and special categories; second, pre-trained language models are fine-tuned for high-precision extraction. A post-processing module is then utilized to restore fine-grained labels, preserving expressiveness for application-level usability. To mitigate data scarcity, a scalable data augmentation strategy leveraging Large Language Models (LLMs) is introduced to expand the label set without full re-annotation, which is a significant novelty of this work. The effectiveness of this method was evaluated across five specific-domain datasets, including logistics, wildlife, and healthcare. Experimental results demonstrate substantial improvements over strong RoBERTa-based baselines. Specifically, the proposed system achieved F1 scores of 90 percent in Customer Service, up from 83 percent; 84 percent in GAM, up from 73 percent; 83 percent in AI Fluent, up from 80 percent; 94 percent in PhoNER_Covid19, up from 91 percent; and 60 percent in Rare Wildlife, up from 36 percent. These findings confirm that the hybrid approach effectively captures the linguistic complexity of Vietnamese and contextual nuances in specialized domains, offering a robust contribution to low-resource NER research.

命名实体识别低资源越南语混合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。