用多种模型检测多语种推文中的网络威胁,发现Bi-LSTM表现最优。
Multi-Lingual Cyber Threat Detection in Tweets/X Using ML, DL, and LLM: A Comparative Analysis
- 构建四语言(英/中/俄/阿)推文数据集,结合人工与极性标注确保质量。
- 在所有语言上,Bi-LSTM性能优于其他深度学习和大模型架构。
- 适合安全研究者、平台风控团队参考,尤其关注跨语言威胁检测。
由于社交媒体上虚假信息和有害内容的泛滥,网络威胁检测已成为数字时代的重要课题。本文针对推文中的隐蔽威胁,开展多语言检测研究。研究分三阶段:首先,收集并标注了英文、中文、俄文和阿拉伯文四类推文数据,采用人工与极性标注相结合的方法保证标注质量;其次,分别使用机器学习(ML)与深度学习(DL)模型对各语言数据进行分析;最后,将四类数据合并为多语言数据集,应用深度学习与大语言模型(LLM)架构评估跨语言威胁识别能力。实验结果表明,随机森林(RF)在机器学习模型中表现最佳,但双向长短期记忆网络(Bi-LSTM)在所有数据集上均显著优于其他深度学习及大模型架构,验证其在多语言网络威胁检测中的有效性。
原文摘要 · Abstract (English)
Cyber threat detection has become an important area of focus in today's digital age due to the growing spread of fake information and harmful content on social media platforms such as Twitter (now 'X'). These cyber threats, often disguised within tweets, pose significant risks to individuals, communities, and even nations, emphasizing the need for effective detection systems. While previous research has explored tweet-based threats, much of the work is limited to specific languages, domains, or locations, or relies on single-model approaches, reducing their applicability to diverse real-world scenarios. To address these gaps, our study focuses on multi-lingual tweet cyber threat detection using a variety of advanced models. The research was conducted in three stages: (1) We collected and labeled tweet datasets in four languages English, Chinese, Russian, and Arabic employing both manual and polarity-based labeling methods to ensure high-quality annotations. (2) Each dataset was analyzed individually using machine learning (ML) and deep learning (DL) models to assess their performance on distinct languages. (3) Finally, we combined all four datasets into a single multi-lingual dataset and applied DL and large language model (LLM) architectures to evaluate their efficacy in identifying cyber threats across various languages. Our results show that among machine learning models, Random Forest (RF) attained the highest performance; however, the Bi-LSTM architecture consistently surpassed other DL and LLM architectures across all datasets. These findings underline the effectiveness of Bi-LSTM in multilingual cyber threat detection. The code for this paper can be found at this link: https://github.com/Mmurrad/Tweet-Data-Classification.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。