多方言阿拉伯语生成与互译模型，支持5种方言与标准语、英语互转。
Aladdin-FTI @ AMIYA Three Wishes for Arabic NLP: Fidelity, Diglossia, and Multidialectal Generation
- 基于大模型构建多方言生成与翻译系统，处理非标准化口语。
- 实现摩洛哥、埃及等5种方言与标准语、英语间的双向转换。
- 开源代码与模型，助力阿拉伯语低资源语言研究。
阿拉伯语方言长期因非标准化和高度变异性，在自然语言处理研究中被严重忽视，给计算建模带来挑战。近期大型语言模型的发展为解决这一问题提供了新思路，使阿拉伯语可被视为多中心语言而非单一体系。本文提出 Aladdin-FTI，作为 AMIYA 共享任务的参赛系统。该系统支持摩洛哥、埃及、巴勒斯坦、叙利亚、沙特五种方言的文本生成，以及这些方言与现代标准阿拉伯语（MSA）和英语之间的双向翻译。代码与训练好的模型已公开发布。
原文摘要 · Abstract (English)
Arabic dialects have long been under-represented in Natural Language Processing (NLP) research due to their non-standardization and high variability, which pose challenges for computational modeling. Recent advances in the field, such as Large Language Models (LLMs), offer promising avenues to address this gap by enabling Arabic to be modeled as a pluricentric language rather than a monolithic system. This paper presents Aladdin-FTI, our submission to the AMIYA shared task. The proposed system is designed to both generate and translate dialectal Arabic (DA). Specifically, the model supports text generation in Moroccan, Egyptian, Palestinian, Syrian, and Saudi dialects, as well as bidirectional translation between these dialects, Modern Standard Arabic (MSA), and English. The code and trained model are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。