将犹太阿拉伯语转写为阿拉伯字母，助力NLP工具应用
A Tale of Two Scripts: Transliteration and Post-Correction for Judeo-Arabic
- 先字符映射再纠错，分两步完成转写
- 首次评测大模型在该任务上的表现
- 使原文本可使用阿拉伯语NLP工具
犹太阿拉伯语是历史上中东地区犹太社群使用的阿拉伯语变体，主要用希伯来字母书写。与标准阿拉伯语不同，其书写存在字母映射模糊、拼写不统一及频繁夹杂希伯来语的问题。本文提出一种两阶段自动转写方法：首先进行简单的字符级映射，再通过后处理校正语法和拼写错误。我们还首次构建了该任务的基准评估，对大语言模型进行了测试。结果表明，转写后的文本可成功应用于阿拉伯语的形态句法标注和机器翻译，而原始文本无法直接使用这些工具。代码与数据已公开。
原文摘要 · Abstract (English)
Judeo-Arabic refers to Arabic variants historically spoken by Jewish communities across the Arab world, primarily during the Middle Ages. Unlike standard Arabic, it is written in Hebrew script by Jewish writers and for Jewish audiences. Transliterating Judeo-Arabic into Arabic script is challenging due to ambiguous letter mappings, inconsistent orthographic conventions, and frequent code-switching into Hebrew. In this paper, we introduce a two-step approach to automatically transliterate Judeo-Arabic into Arabic script: simple character-level mapping followed by post-correction to address grammatical and orthographic errors. We also present the first benchmark evaluation of LLMs on this task. Finally, we show that transliteration enables Arabic NLP tools to perform morphosyntactic tagging and machine translation, which would have not been feasible on the original texts. We make our code and data publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。