arXiv:2605.24556cs.IRcs.CL2026-05中稿 · the 1st Workshop o…

阿姆哈拉语检索表现差,零样本多语言模型无法可靠支持弱势语言。

The Multilingual Curse at the Retrieval Layer: Evidence from Amharic

  • 对比零样本、微调和单语模型在阿姆哈拉语检索中的表现。
  • 零样本模型比最强单语模型低23%相对MRR@10,微调后提升32%-60%。
  • 研究呼吁为弱势语言做本地化评估与适配,而非依赖多语言基准。

多语言检索日益支撑跨语言问答与检索增强生成。当前多语言基准上的零样本高分常被视为编码器跨语言迁移可靠的证据。我们指出,这一假设在表达丰富、资源不足的语言中失效,以阿姆哈拉语为诊断案例。在涵盖密集、后期交互、学习稀疏与交叉编码范式的共享段落检索协议下,比较了零样本多语言检索器、阿姆哈拉语微调的多语言检索器与单语阿姆哈拉语检索器。最强零样本多语言检索器在MRR@10上比最强单语阿姆哈拉语检索器低23%相对性能。在同一阿姆哈拉语数据上微调两个近期多语言嵌入模型,带来32%-60%相对MRR@10提升,但最佳微调模型仍低于最强单语模型。结果表明,零样本多语言检索不能作为大模型时代公平信息获取的充分代理:对弱势语言,检索必须进行本语种评估与适配,而非从聚合多语言基准推断。为促进未来研究,我们公开发布数据集、代码库与训练模型(https://github.com/rasyosef/amharic-neural-ir)。

原文摘要 · Abstract (English)

Multilingual retrieval increasingly underpins cross-lingual question answering and retrieval-augmented generation. Strong zero-shot scores on multilingual benchmarks are often taken as evidence that current encoders transfer reliably across many languages. We argue that this assumption breaks down for underrepresented, morphologically rich languages, and use Amharic as a diagnostic case. Under a shared passage retrieval protocol covering dense, late-interaction, learned sparse, and cross-encoder paradigms, we compare zero-shot multilingual retrievers, Amharic-fine-tuned multilingual retrievers, and monolingual Amharic retrievers. The strongest zero-shot multilingual retriever underperforms the strongest monolingual Amharic first-stage retriever by 23% relative MRR@10. Fine-tuning two recent multilingual embedding models on the same Amharic supervision yields 32-60% relative MRR@10 gains over zero-shot, but the best Amharic-fine-tuned multilingual model remains below the strongest monolingual Amharic retriever. These findings indicate that zero-shot multilingual retrieval is not a sufficient proxy for equitable information access in the LLM era: for underrepresented languages, retrieval must be evaluated and adapted in-language rather than inferred from aggregate multilingual benchmarks. To foster future research, we publicly release the dataset, codebase, and trained models at https://github.com/rasyosef/amharic-neural-ir.

多语言检索阿姆哈拉语信息获取单语评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。