首个用于马拉维语短信欺诈检测的机器学习研究
Using Machine Learning to Detect Fraudulent SMSs in Chichewa
- 构建首个马拉维语短信欺诈数据集并扩展规模
- 模型在本地语言上准确率超96%,翻译后性能下降
- 强调针对本地语言建模的重要性,避免依赖英文工具
短信诈骗在全球范围内备受关注。基于机器学习构建短信欺诈分类器需使用合适的数据集进行训练与验证。现有研究多集中于英语短信数据集。本文首次提出针对非洲主要语言之一——马拉维语的短信欺诈检测数据集,并报告了在马拉维语短信上使用机器学习算法进行欺诈/非欺诈分类的实验。研究回答了为马拉维语短信开发机器学习分类模型的可行性问题。为此,我们构建了三个数据集:通过面向青年群体的实地调研收集少量马拉维语短信数据,采用保持标签的文本变换方法扩大数据规模;将扩增后的数据分别通过人工翻译和机器翻译转换为英文。对马拉维语及翻译后的数据集,分别使用随机森林和逻辑回归进行分类。结果显示,两种模型在马拉维语数据集上的准确率均超过96%。而从马拉维语转向翻译后数据集时,性能出现下降。这凸显了多语言或跨语言NLP任务中数据预处理的重要性,也揭示了依赖机器翻译文本训练模型所面临的挑战。研究结果强调,为优化准确率与性能,应为短信欺诈检测开发语言特定模型。由于多数机器学习模型需数据预处理,必须深入探究依赖英文专用工具所带来的影响。
原文摘要 · Abstract (English)
SMS enabled fraud is of great concern globally. Building classifiers based on machine learning for SMS fraud requires the use of suitable datasets for model training and validation. Most research has centred on the use of datasets of SMSs in English. This paper introduces a first dataset for SMS fraud detection in Chichewa, a major language in Africa, and reports on experiments with machine learning algorithms for classifying SMSs in Chichewa as fraud or non-fraud. We answer the broader research question of how feasible it is to develop machine learning classification models for Chichewa SMSs. To do that, we created three datasets. A small dataset of SMS in Chichewa was collected through primary research from a segment of the young population. We applied a label-preserving text transformations to increase its size. The enlarged dataset was translated into English using two approaches: human translation and machine translation. The Chichewa and the translated datasets were subjected to machine classification using random forest and logistic regression. Our findings indicate that both models achieved a promising accuracy of over 96% on the Chichewa dataset. There was a drop in performance when moving from the Chichewa to the translated dataset. This highlights the importance of data preprocessing, especially in multilingual or cross-lingual NLP tasks, and shows the challenges of relying on machine-translated text for training machine learning models. Our results underscore the importance of developing language specific models for SMS fraud detection to optimise accuracy and performance. Since most machine learning models require data preprocessing, it is essential to investigate the impact of the reliance on English-specific tools for data preprocessing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。