用多语言示例提升低资源语言的模型表现,效果优于单语示范。
Blessing of Multilinguality: A Systematic Analysis of Multilingual In-Context Learning
- 用高资源语言混合示例增强跨语言迁移能力
- 多语言示范在低资源语言任务上显著优于纯英语示范
- 非相关外语句子也能带来性能提升,凸显多语言暴露价值
尽管多语言大模型整体表现尚可,甚至在高资源语言上媲美英语,但在低资源语言上仍明显落后。针对这一差距,多语言上下文学习(Multilingual In-Context Learning, ICL)在目标语言示例不可用时尤为有效。本文系统分析了以高资源语言(HRLs)示例促进跨语言迁移的机制。结果表明,混合使用多种高资源语言的示例始终优于仅使用英语示例,尤其在低资源语言任务中表现更优。意外发现:提示中加入无关的非英语句子也能带来可观性能提升,说明多语言经验本身具有增益作用。研究揭示了战略性利用多语言资源以缩小低资源语言性能差距的潜力。
原文摘要 · Abstract (English)
While multilingual large language models generally perform adequately, and sometimes even rival English performance on high-resource languages (HRLs), they often significantly underperform on low-resource languages (LRLs). Among several prompting strategies aiming at bridging the gap, multilingual in-context learning (ICL) has been particularly effective when demonstration in target languages is unavailable. However, there lacks a systematic understanding of when and why it works well. In this work, we systematically analyze multilingual ICL, using demonstrations in HRLs to enhance cross-lingual transfer. We show that demonstrations in mixed HRLs consistently outperform English-only ones across the board, particularly for tasks written in LRLs. Surprisingly, our ablation study shows that the presence of irrelevant non-English sentences in the prompt yields measurable gains, suggesting the effectiveness of multilingual exposure itself. Our results highlight the potential of strategically leveraging multilingual resources to bridge the performance gap for underrepresented languages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。