arXiv:2505.08004cs.CLcs.AI2025-05中稿 · presentation at FI…综述被引 13

综述大模型在阿拉伯语处理中的应用与挑战

Large Language Models and Arabic Content: A Review

  • 梳理预训练大模型在阿拉伯语任务中的应用方法
  • 指出多语言模型在阿拉伯语多种任务中表现优异
  • 适合关注中东语言AI的研究者和开发者

过去三年,大语言模型(LLMs)的快速发展对人工智能多个领域产生了深远影响,尤其在自然语言处理(NLP)方面,涵盖多种语言,包括阿拉伯语。尽管阿拉伯语是阿拉伯世界27个国家的通用语言,并在部分非阿拉伯国家作为第二语言使用,但相关资源、数据集和工具仍然稀缺。阿拉伯语自然语言处理面临诸多挑战,如丰富的词形变化、复杂的语法结构以及多样化的书写标准等。研究人员正积极应对这些挑战,表明在多语言语料上预训练的大语言模型在各类阿拉伯语NLP任务中已取得显著成果。本文综述了大语言模型在阿拉伯语中的应用,重点介绍早期预训练阿拉伯语模型在多种NLP任务及方言处理中的表现,同时探讨微调和提示工程等技术对模型性能的提升作用。此外,本文还总结了常见的阿拉伯语基准测试数据集,并观察到大模型在阿拉伯语领域的采用率持续上升。

原文摘要 · Abstract (English)

Over the past three years, the rapid advancement of Large Language Models (LLMs) has had a profound impact on multiple areas of Artificial Intelligence (AI), particularly in Natural Language Processing (NLP) across diverse languages, including Arabic. Although Arabic is considered one of the most widely spoken languages across 27 countries in the Arabic world and used as a second language in some other non-Arabic countries as well, there is still a scarcity of Arabic resources, datasets, and tools. Arabic NLP tasks face various challenges due to the complexities of the Arabic language, including its rich morphology, intricate structure, and diverse writing standards, among other factors. Researchers have been actively addressing these challenges, demonstrating that pre-trained Large Language Models (LLMs) trained on multilingual corpora achieve significant success in various Arabic NLP tasks. This study provides an overview of using large language models (LLMs) for the Arabic language, highlighting early pre-trained Arabic Language models across various NLP applications and their ability to handle diverse Arabic content tasks and dialects. It also provides an overview of how techniques like finetuning and prompt engineering can enhance the performance of these models. Additionally, the study summarizes common Arabic benchmarks and datasets while presenting our observations on the persistent upward trend in the adoption of LLMs.

大模型阿拉伯语NLP综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。