Claude AI在13种马里小语种上展现意外翻译潜力
The Serendipity of Claude AI: Case of the 13 Low-Resource National Languages of Mali
- 测试13种马里官方语言，评估其在资源极少时的表现
- 虽无法生成完整通顺文本，但能模仿部分语言特征
- 适合关注低资源语言技术突破的研究者
近期人工智能与自然语言处理进展提升了少数语言的表示能力，但包括马里13种官方民族语言在内的多数语言仍缺乏自动翻译与生成式AI支持。本文评估了Claude AI在马里13种民族语言上的翻译表现，除使用ChrF2和BLEU评分外，还由人工评估翻译准确性、上下文一致性、对方言变异的鲁棒性、语言偏见处理、小语料适应能力及可理解性。研究发现，Claude AI在语言资源极有限的情况下仍具稳健表现；尽管无法为资源极少的语言生成清晰连贯文本，但仍能生成体现语言某些特征的结果。
原文摘要 · Abstract (English)
Recent advances in artificial intelligence (AI) and natural language processing (NLP) have improved the representation of underrepresented languages. However, most languages, including Mali's 13 official national languages, continue to be poorly supported or unsupported by automatic translation and generative AI. This situation appears to have slightly improved with certain recent LLM releases. The study evaluated Claude AI's translation performance on each of the 13 national languages of Mali. In addition to ChrF2 and BLEU scores, human evaluators assessed translation accuracy, contextual consistency, robustness to dialect variations, management of linguistic bias, adaptation to a limited corpus, and ease of understanding. The study found that Claude AI performs robustly for languages with very modest language resources and, while unable to produce understandable and coherent texts for Malian languages with minimal resources, still manages to produce results which demonstrate the ability to mimic some elements of the language.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。