arXiv:2505.19128cs.CLcs.AI2025-05

用动态LoRA解决多语言命名实体识别中的干扰问题,提升低资源语言性能。

RetrieveAll: A Multilingual Named Entity Recognition Framework with Large Language Models

  • 通过动态LoRA解耦跨语言任务特征,实现高效多语言适配。
  • 在PAN-X数据集上平均F1提升12.1%,显著优于现有基线。
  • 无需外部资源,适合低资源语言的通用多语言NER应用。

大语言模型在高资源语言的命名实体识别(NER)中取得显著进展,但在低、中资源语言中仍有巨大提升空间。现有多语言NER方法在多语言适配过程中面临严重语言干扰,表现为不同语言间特征冲突以及高资源语言对低资源语言特征的抑制。尽管为每种语言单独训练模型可缓解干扰,但缺乏可扩展性且计算成本过高。为此,我们提出RetrieveAll,一种基于动态LoRA的通用多语言NER框架。该框架解耦跨语言任务特征,展现出高效的动态适应能力。此外,我们引入一种跨粒度知识增强方法,充分利用数据内在潜力,无需依赖外部资源。通过层次化提示机制引导知识注入,推动范式从“提示引导推理”转向“提示驱动学习”。实验结果表明,RetrieveAll优于现有基线;在PAN-X数据集上,平均F1提升12.1%。

原文摘要 · Abstract (English)

The rise of large language models has led to significant performance breakthroughs in named entity recognition (NER) for high-resource languages, yet there remains substantial room for improvement in low- and medium-resource languages. Existing multilingual NER methods face severe language interference during the multi-language adaptation process, manifested in feature conflicts between different languages and the competitive suppression of low-resource language features by high-resource languages. Although training a dedicated model for each language can mitigate such interference, it lacks scalability and incurs excessive computational costs in real-world applications. To address this issue, we propose RetrieveAll, a universal multilingual NER framework based on dynamic LoRA. The framework decouples task-specific features across languages and demonstrates efficient dynamic adaptability. Furthermore, we introduce a cross-granularity knowledge augmented method that fully exploits the intrinsic potential of the data without relying on external resources. By leveraging a hierarchical prompting mechanism to guide knowledge injection, this approach advances the paradigm from "prompt-guided inference" to "prompt-driven learning." Experimental results show that RetrieveAll outperforms existing baselines; on the PAN-X dataset, it achieves an average F1 improvement of 12.1 percent.

命名实体识别多语言LoRA大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。