arXiv:2501.13944cs.CLcs.AI2025-01被引 88

打造面向阿拉伯语的多模态生成平台,支持文本、语音、图像等跨模态创作。

Fanar: An Arabic-Centric Multimodal Generative AI Platform

  • 基于1万亿条清洗后的阿拉伯语/英语/代码数据训练出70亿和90亿参数模型。
  • 支持宗教与近期事件的精准检索增强生成,提升内容相关性与时效性。
  • 集成方言语音识别与地域化图像生成,适合中东地区AI应用开发者使用。

我们提出Fanar,一个面向阿拉伯语的多模态生成AI平台,支持语言、语音和图像生成任务。平台核心为两个高性能阿拉伯语大语言模型:Fanar Star(70亿参数)从零训练,基于近1万亿条清洁去重的阿拉伯语、英语和代码数据;Fanar Prime(90亿参数)基于Gemma-2 9B模型持续训练相同数据集。两模型通过自研调度器透明路由不同提示,实现协同部署。平台还包含定制伊斯兰检索增强生成(RAG)系统,用于处理宗教类问题;以及时效性RAG,可总结预训练数据截止日期后发生的事件。此外,平台具备本地化双语语音识别(支持多种阿拉伯方言)、区域性优化的语音与图像生成能力,并提供生成内容真实性验证服务。Fanar的设计、开发与实现均由卡塔尔计算研究研究所(QCRI)完成,由卡塔尔通信与信息科技部资助,旨在推动主权AI技术发展。

原文摘要 · Abstract (English)

We present Fanar, a platform for Arabic-centric multimodal generative AI systems, that supports language, speech and image generation tasks. At the heart of Fanar are Fanar Star and Fanar Prime, two highly capable Arabic Large Language Models (LLMs) that are best in the class on well established benchmarks for similar sized models. Fanar Star is a 7B (billion) parameter model that was trained from scratch on nearly 1 trillion clean and deduplicated Arabic, English and Code tokens. Fanar Prime is a 9B parameter model continually trained on the Gemma-2 9B base model on the same 1 trillion token set. Both models are concurrently deployed and designed to address different types of prompts transparently routed through a custom-built orchestrator. The Fanar platform provides many other capabilities including a customized Islamic Retrieval Augmented Generation (RAG) system for handling religious prompts, a Recency RAG for summarizing information about current or recent events that have occurred after the pre-training data cut-off date. The platform provides additional cognitive capabilities including in-house bilingual speech recognition that supports multiple Arabic dialects, voice and image generation that is fine-tuned to better reflect regional characteristics. Finally, Fanar provides an attribution service that can be used to verify the authenticity of fact based generated content. The design, development, and implementation of Fanar was entirely undertaken at Hamad Bin Khalifa University's Qatar Computing Research Institute (QCRI) and was sponsored by Qatar's Ministry of Communications and Information Technology to enable sovereign AI technology development.

多模态生成阿拉伯语AI检索增强本土化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。