构建首个阿拉伯语写作辅助数据集，推动AI写作工具发展
Gazelle: An Instruction Dataset for Arabic Writing Assistance
- 构建大规模阿拉伯语写作辅助数据集Gazelle
- 评估GPT-4等主流模型在阿拉伯语写作中的表现
- 为阿拉伯语AI写作工具研究提供基准和方向
写作被视为人类智能的标志，仍是人工智能领域的高难度任务。尽管生成式AI与大语言模型（LLMs）快速发展，但阿拉伯语等低资源语言在写作辅助工具开发上仍面临严重数据短缺问题。为此，本文提出Gazelle——首个面向阿拉伯语写作辅助的综合性数据集，并构建评估框架。对GPT-4、GPT-4o、Cohere Command R+及Gemini 1.5 Pro等主流模型的人类评估揭示了其在处理阿拉伯语写作挑战时的优势与局限。研究强调持续训练与数据扩充对提升阿拉伯语自然语言处理能力的重要性，为更有效的阿拉伯语AI写作工具铺平道路。
原文摘要 · Abstract (English)
Writing has long been considered a hallmark of human intelligence and remains a pinnacle task for artificial intelligence (AI) due to the intricate cognitive processes involved. Recently, rapid advancements in generative AI, particularly through the development of Large Language Models (LLMs), have significantly transformed the landscape of writing assistance. However, underrepresented languages like Arabic encounter significant challenges in the development of advanced AI writing tools, largely due to the limited availability of data. This scarcity constrains the training of effective models, impeding the creation of sophisticated writing assistance technologies. To address these issues, we present Gazelle, a comprehensive dataset for Arabic writing assistance. In addition, we offer an evaluation framework designed to enhance Arabic writing assistance tools. Our human evaluation of leading LLMs, including GPT-4, GPT-4o, Cohere Command R+, and Gemini 1.5 Pro, highlights their respective strengths and limitations in addressing the challenges of Arabic writing. Our findings underscore the need for continuous model training and dataset enrichment to manage the complexities of Arabic language processing, paving the way for more effective AI-powered Arabic writing tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。