arXiv:2608.29959cs.CL2026-08

对比生成与编码模型在11种印度语言NER上的表现,发现编码模型显著更优。

Generative vs. Encoder Models for Multilingual NER: A Comprehensive Empirical Study on Naamapadam

论文配图:Generative vs. Encoder Models for Multilingual NER: A Comprehensive Empirical Study on Naamapadam
图 1 · 摘自论文原文
  • 比较了生成式与编码型模型在多语言命名实体识别中的效果
  • 编码模型在10种语言上领先生成模型7.5%-40%的准确率
  • 提出三类语言集群,指导低资源场景下的模型部署

语言是人类最重要的技术,但对印度22种官方语言中超过十亿使用者而言,其数字化基础仍不完整。命名实体识别(NER)作为将原始文本转化为机器可理解知识的关键步骤,虽在英语中研究深入,但在多数印地语系语言中仍未解决。本文对Naamapadam基准测试中全部11种语言的生成式与编码型神经架构进行了严谨的对比研究。评估涵盖五类经典模型:序列到序列Transformer与多语言编码器;四种通过LoRA微调及4比特NF4量化处理的解码器仅大型语言模型(LLMs);以及九种零样本至五样本推理的生成模型。在严格的CoNLL跨度级评估下,编码模型(mBERT与XLM-R在印地语上F1=0.675)在10种语言中显著优于所有生成模型,与最强生成对手(Gemma-2-2B:平均F1=0.427)的差距为7.5至40个百分点。最佳少样本结果仅达到编码基线的28%。研究识别出三种语言聚类——编码主导、部分覆盖与失败区域,并基于迁移学习和低资源NLP原则提供可操作的部署指南。

原文摘要 · Abstract (English)

Language is humanity's most consequential technology, yet for over a billion speakers across India's twenty-two constitutionally recognised languages, its digital layer remains structurally incomplete. Named Entity Recognition (NER), the foundational step in transforming raw text into machine-interpretable knowledge, has been studied exhaustively for English but remains largely unsolved across most Indic languages. This paper presents a rigorous comparative study of generative and encoder-based neural architectures for NER on all eleven languages of the Naamapadam benchmark. We evaluate five classic model families spanning sequence-to-sequence transformers and multilingual encoders; four decoder-only large language models (LLMs) fine-tuned with LoRA and 4-bit NF4 quantisation; and nine generative models in zero-to-5-shot inference. Under strict CoNLL span-level evaluation, encoder-based models (mBERT and XLM-R, both F1=0.675 on Hindi) substantially outperform every generative architecture in ten of eleven languages, with gaps of 7.5-40 percentage points against the strongest competitor (Gemma-2-2B: avg F1=0.427). The best few-shot result reaches only 28% of the encoder baseline. We identify three language clusters--encoder-dominant, partial-coverage, and failure-zone; and provide actionable deployment guidelines grounded in transfer learning and low-resource NLP principles.

多语言NER编码模型低资源语言生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。