arXiv:2507.16002cs.CLcs.AI2025-07

用外部知识增强低资源印地语命名实体识别,效果显著提升。

Enhancing Hindi NER in Low Context: A Comparative study of Transformer-based models with vs. without Retrieval Augmentation

  • 用维基百科检索增强模型输入,弥补低资源语言信息不足
  • 无微调的生成模型经增强后性能优于基线,大模型效果更明显
  • 小模型微调+检索增强表现最佳,适合资源有限场景

命名实体识别(NER)是自然语言处理中的关键挑战,旨在识别和分类文本中的命名实体。本研究针对印地语低资源环境下的NER问题,比较了基于Transformer的模型(MuRIL、XLM-R、Llama2-7B、Llama2-70B、Llama3-70B及GPT3.5-turbo)在有无检索增强(RA)情况下的表现。使用维基百科作为外部上下文进行数据检索增强。对MuRIL和XLM-R进行微调并对比有无RA的效果;而大模型则用于少样本生成。结果表明,引入检索增强后,MuRIL和XLM-R的宏平均F1得分分别从0.69、0.495提升至0.70、0.71。微调后的Llama2-7B显著优于未微调版本。未微调的生成模型在检索增强下也表现更好,其中GPT3.5-turbo受益明显,但Llama2-70B和Llama3-70B未有效利用检索内容。研究证实,检索增强能显著提升低资源语言的NER性能,为有限资源语言的模型优化提供有效路径。

原文摘要 · Abstract (English)

One major challenge in natural language processing is named entity recognition (NER), which identifies and categorises named entities in textual input. In order to improve NER, this study investigates a Hindi NER technique that makes use of Hindi-specific pretrained encoders (MuRIL and XLM-R) and Generative Models ( Llama-2-7B-chat-hf (Llama2-7B), Llama-2-70B-chat-hf (Llama2-70B), Llama-3-70B-Instruct (Llama3-70B) and GPT3.5-turbo), and augments the data with retrieved data from external relevant contexts, notably from Wikipedia. We have fine-tuned MuRIL, XLM-R and Llama2-7B with and without RA. However, Llama2-70B, lama3-70B and GPT3.5-turbo are utilised for few-shot NER generation. Our investigation shows that the mentioned language models (LMs) with Retrieval Augmentation (RA) outperform baseline methods that don't incorporate RA in most cases. The macro F1 scores for MuRIL and XLM-R are 0.69 and 0.495, respectively, without RA and increase to 0.70 and 0.71, respectively, in the presence of RA. Fine-tuned Llama2-7B outperforms Llama2-7B by a significant margin. On the other hand the generative models which are not fine-tuned also perform better with augmented data. GPT3.5-turbo adopted RA well; however, Llama2-70B and llama3-70B did not adopt RA with our retrieval context. The findings show that RA significantly improves performance, especially for low-context data. This study adds significant knowledge about how best to use data augmentation methods and pretrained models to enhance NER performance, particularly in languages with limited resources.

命名实体识别低资源语言检索增强印地语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。