为阿尔及利亚方言设计智能对话系统,解决拼写混乱与多语混用难题。
dziribot: rag based intelligent conversational agent for algerian arabic dialect
- 融合RAG与专用NLU,支持结构化流程与知识增强应答
- 微调DziriBERT在稀疏数据下表现最优,远超传统基线
- 适合需要本地化方言服务的中东北非企业落地应用
随着客户服务数字化加速,对精准自然交互的对话代理需求激增。在阿尔及利亚语境中,这一需求因达吉亚方言(Darja)的语言复杂性而加剧:其拼写不统一、频繁混用法语,且阿拉伯语与拉丁字母(Arabizi)并行使用。本文提出DziriBOT,一种专为克服这些挑战设计的混合智能对话代理。采用多层次架构,结合专用自然语言理解(NLU)与检索增强生成(RAG),实现结构化服务流程与基于企业文档的知识密集型应答。针对达吉亚语资源稀缺问题,系统评估三种方法:基于稀疏特征的Rasa管道、经典机器学习基线及基于Transformer的微调。实验表明,微调后的DziriBERT模型达到当前最佳性能,尤其在处理拼写噪声和罕见意图时显著优于传统方法。最终,DziriBOT提供了一种稳健可扩展的解决方案,弥合了通用语言模型与阿尔及利亚用户语言现实之间的差距,为区域市场方言感知自动化提供了范本。
原文摘要 · Abstract (English)
The rapid digitalization of customer service has intensified the demand for conversational agents capable of providing accurate and natural interactions. In the Algerian context, this is complicated by the linguistic complexity of Darja, a dialect characterized by non-standardized orthography, extensive code-switching with French, and the simultaneous use of Arabic and Latin (Arabizi) scripts. This paper introduces DziriBOT, a hybrid intelligent conversational agent specifically engineered to overcome these challenges. We propose a multi-layered architecture that integrates specialized Natural Language Understanding (NLU) with Retrieval-Augmented Generation (RAG), allowing for both structured service flows and dynamic, knowledge-intensive responses grounded in curated enterprise documentation. To address the low-resource nature of Darja, we systematically evaluate three distinct approaches: a sparse-feature Rasa pipeline, classical machine learning baselines, and transformer-based fine-tuning. Our experimental results demonstrate that the fine-tuned DziriBERT model achieves state-of-the-art performance. These results significantly outperform traditional baselines, particularly in handling orthographic noise and rare intents. Ultimately, DziriBOT provides a robust, scalable solution that bridges the gap between formal language models and the linguistic realities of Algerian users, offering a blueprint for dialect-aware automation in the regional market.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。