用n-gram和朴素贝叶斯识别利比亚方言,准确率达85.9%
Computational Linguistics Meets Libyan Dialect: A Study on Dialect Identification
- 基于词和字符n-gram特征,选用多类朴素贝叶斯分类
- 最佳模型达85.89%准确率,显著优于逻辑回归与线性SVM
- 为阿拉伯语方言NLP提供可复现的基准与方法参考
本研究采用逻辑回归、线性支持向量机、多项式朴素贝叶斯(MNB)和伯努利朴素贝叶斯对来自推特的利比亚方言语句进行分类。实验基于包含18种阿拉伯语方言共54万句的QADI语料库。预处理需应对拼写不一致等非标准书写问题。卡方检验显示邮件提及和情感标志等特征与方言无显著关联,故剔除。主要开展两项实验:一是通过卡方检验评估语料元特征显著性;二是使用不同词和字符n-gram表示评估分类器性能。结果表明,当采用(1,2)词n-gram与(1,5)字符n-gram时,MNB取得最高准确率85.89%和F1分数0.85741,优于逻辑回归(84.41%)与线性SVM(84.73%)。Log loss、Cohen kappa与马修相关系数等指标进一步验证了MNB的有效性。研究揭示合理n-gram设计与模型选择对提升利比亚方言识别精度至关重要,为阿拉伯语方言自然语言处理提供实证基准与实践启示。
原文摘要 · Abstract (English)
This study investigates logistic regression, linear support vector machine, multinomial Naive Bayes, and Bernoulli Naive Bayes for classifying Libyan dialect utterances gathered from Twitter. The dataset used is the QADI corpus, which consists of 540,000 sentences across 18 Arabic dialects. Preprocessing challenges include handling inconsistent orthographic variations and non-standard spellings typical of the Libyan dialect. The chi-square analysis revealed that certain features, such as email mentions and emotion indicators, were not significantly associated with dialect classification and were thus excluded from further analysis. Two main experiments were conducted: (1) evaluating the significance of meta-features extracted from the corpus using the chi-square test and (2) assessing classifier performance using different word and character n-gram representations. The classification experiments showed that Multinomial Naive Bayes (MNB) achieved the highest accuracy of 85.89% and an F1-score of 0.85741 when using a (1,2) word n-gram and (1,5) character n-gram representation. In contrast, Logistic Regression and Linear SVM exhibited slightly lower performance, with maximum accuracies of 84.41% and 84.73%, respectively. Additional evaluation metrics, including log loss, Cohen kappa, and Matthew correlation coefficient, further supported the effectiveness of MNB in this task. The results indicate that carefully selected n-gram representations and classification models play a crucial role in improving the accuracy of Libyan dialect identification. This study provides empirical benchmarks and insights for future research in Arabic dialect NLP applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。