提升阿拉伯方言到标准语的翻译质量,尤其在资源有限时仍有效。
Advancing Dialectal Arabic to Modern Standard Arabic Machine Translation
- 采用自修正提示策略与轻量微调,减少翻译错漏。
- 4比特量化使内存降低60%,性能损失不足1%。
- 多方言联合训练比单方言提升超10%,适合资源受限场景。
阿拉伯方言(DA)是自然语言处理的重大挑战,因阿拉伯世界日常交流多用方言,而这些方言与现代标准阿拉伯语(MSA)差异显著,阻碍了阿拉伯语机器翻译进展。本文针对黎凡特、埃及和海湾方言,在低资源和计算受限环境下,提出两项核心贡献:(i) 对无训练提示技术的全面评估,(ii) 开发资源高效的微调流程。对六种大语言模型的提示策略评估显示,少样本提示始终优于零样本、思维链及提出的Ara-TEaR方法。Ara-TEaR为三阶段自修正提示流程,聚焦于方言到标准语中常见的意义传递与适应错误。评估中GPT-4o在所有提示设置下表现最佳。微调方面,量化后的Gemma2-9B模型达到chrF++分数49.88,优于零样本GPT-4o的44.58。多方言联合训练模型性能比单方言模型高出超过10% chrF++,4比特量化使内存使用减少60%,性能损失低于1%。实验结果为提升阿拉伯语方言包容性提供了实用蓝图,表明即使资源有限,高质量的DA-MSA机器翻译也可实现,推动更包容的语言技术发展。
原文摘要 · Abstract (English)
Dialectal Arabic (DA) poses a persistent challenge for natural language processing (NLP), as most everyday communication in the Arab world occurs in dialects that diverge significantly from Modern Standard Arabic (MSA). This linguistic divide impedes progress in Arabic machine translation. This paper presents two core contributions to advancing DA-MSA translation for the Levantine, Egyptian, and Gulf dialects, particularly in low-resource and computationally constrained settings: (i) a comprehensive evaluation of training-free prompting techniques, and (ii) the development of a resource-efficient fine-tuning pipeline. Our evaluation of prompting strategies across six large language models (LLMs) found that few-shot prompting consistently outperformed zero-shot, chain-of-thought, and our proposed Ara-TEaR method. Ara-TEaR is designed as a three-stage self-refinement prompting process, targeting frequent meaning-transfer and adaptation errors in DA-MSA translation. In this evaluation, GPT-4o achieved the highest performance across all prompting settings. For fine-tuning LLMs, a quantized Gemma2-9B model achieved a chrF++ score of 49.88, outperforming zero-shot GPT-4o (44.58). Joint multi-dialect trained models outperformed single-dialect counterparts by over 10% chrF++, and 4-bit quantization reduced memory usage by 60% with less than 1% performance loss. The results and insights of our experiments offer a practical blueprint for improving dialectal inclusion in Arabic NLP, showing that high-quality DA-MSA machine translation is achievable even with limited resources and paving the way for more inclusive language technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。