对比多种模型,发现深度学习混合模型在识别新冠谣言上更有效。
A Comparative Study of Hybrid Models in Health Misinformation Text Classification
- 用混合卷积与循环网络结构提升文本分类性能
- 混合模型在准确率、F1等指标上均超98%
- 适合需要高精度谣言检测的公共卫生研究者
本研究评估了机器学习(ML)与深度学习(DL)模型在在线社交网络(OSNs)上检测新冠疫情相关健康谣言的有效性,旨在开发更有效的工具以应对疫情期间的信息泛滥。研究在「COVID19-FNIR DATASET」数据集上训练并测试了多种分类器:朴素贝叶斯、SVM、随机森林等传统机器学习模型,以及卷积神经网络(CNN)、长短期记忆网络(LSTM)、CNN+LSTM混合模型,还有预训练语言模型(DistilBERT、RoBERTa)。通过词干化与词形还原等预处理技术,评估其准确率、F1分数、召回率、精确率及ROC表现。结果表明,支持向量机(SVM)表现良好,达到94.41%的F1分数;采用Word2Vec嵌入的深度学习模型在所有指标上均超过98%;而CNN+LSTM混合模型同样全面超越98%,优于DistilBERT和RoBERTa等预训练模型。研究结论为:深度学习与混合深度学习模型在检测新冠谣言方面显著优于传统机器学习方法。研究强调了先进神经网络与大规模预训练在谣言检测中的关键作用。未来工作应优化模型以适应不同类型的虚假信息,并适配不断变化的社交平台,助力健康谣言防控。
原文摘要 · Abstract (English)
This study evaluates the effectiveness of machine learning (ML) and deep learning (DL) models in detecting COVID-19-related misinformation on online social networks (OSNs), aiming to develop more effective tools for countering the spread of health misinformation during the pan-demic. The study trained and tested various ML classifiers (Naive Bayes, SVM, Random Forest, etc.), DL models (CNN, LSTM, hybrid CNN+LSTM), and pretrained language models (DistilBERT, RoBERTa) on the "COVID19-FNIR DATASET". These models were evaluated for accuracy, F1 score, recall, precision, and ROC, and used preprocessing techniques like stemming and lemmatization. The results showed SVM performed well, achieving a 94.41% F1-score. DL models with Word2Vec embeddings exceeded 98% in all performance metrics (accuracy, F1 score, recall, precision & ROC). The CNN+LSTM hybrid models also exceeded 98% across performance metrics, outperforming pretrained models like DistilBERT and RoBERTa. Our study concludes that DL and hybrid DL models are more effective than conventional ML algorithms for detecting COVID-19 misinformation on OSNs. The findings highlight the importance of advanced neural network approaches and large-scale pretraining in misinformation detection. Future research should optimize these models for various misinformation types and adapt to changing OSNs, aiding in combating health misinformation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。