评测大模型对阿拉伯语混合拼写文的翻译能力
Arabizi vs LLMs: Can the Genie Understand the Language of Aladdin?
- 对比多个大模型在阿拉伯语混合拼写文上的解码与翻译表现
- 发现英语翻译优于标准阿拉伯语，部分方言翻译准确率超60%
- 针对社交网络常用方言，填补小众语言研究空白
随着技术快速发展，沟通形式持续演进，新兴语言现象不断涌现。其中，Arabizi 是一种融合拉丁字母和数字的阿拉伯语混合书写形式，用于表达阿拉伯社区的口语方言。该语言广泛应用于社交媒体，使交流更轻松灵活，但因缺乏正式结构和深层文化内涵，给机器翻译带来巨大挑战。本案例研究源于对 Arabizi 进行快速理解性翻译的迫切需求。通过人工评估与自动指标相结合，系统评估了不同大模型在将 Arabizi 翻译为现代标准阿拉伯语和英语方面的表现，重点关注此前研究较少的多种阿拉伯语方言。核心问题包括：哪些方言翻译效果最佳，以及英文翻译是否优于阿拉伯语翻译。
原文摘要 · Abstract (English)
In this era of rapid technological advancements, communication continues to evolve as new linguistic phenomena emerge. Among these is Arabizi, a hybrid form of Arabic that incorporates Latin characters and numbers to represent the spoken dialects of Arab communities. Arabizi is widely used on social media and allows people to communicate in an informal and dynamic way, but it poses significant challenges for machine translation due to its lack of formal structure and deeply embedded cultural nuances. This case study arises from a growing need to translate Arabizi for gisting purposes. It evaluates the capacity of different LLMs to decode and translate Arabizi, focusing on multiple Arabic dialects that have rarely been studied up until now. Using a combination of human evaluators and automatic metrics, this research project investigates the model's performance in translating Arabizi into both Modern Standard Arabic and English. Key questions explored include which dialects are translated most effectively and whether translations into English surpass those into Arabic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。