用可解释AI识别加密流量中的恶意行为,准确率超99%。
Integrating Explainable AI for Effective Malware Detection in Encrypted Network Traffic
- 结合多视角特征与集成学习模型,不需解密即可检测恶意流量。
- 自建数据集含1127条连接、54种木马家族,精度达99.32%以上。
- 通过SHAP分析揭示关键特征,提升模型决策透明度。
加密网络通信保障了端点间的数据机密性、完整性和隐私性,但攻击者正越来越多地利用加密隐藏恶意行为。在不解密报文的前提下检测未知加密恶意流量仍是重大挑战。本研究探索可解释人工智能(XAI)技术在恶意流量检测中的应用,采用集成学习模型,基于加密通信的多个维度提取多视角特征进行检测。为有效表征恶意通信,我们构建了一个包含1127个唯一连接、覆盖54种恶意软件家族的稳健数据集,规模超过现有任何开源数据集。模型在CTU-13数据集上表现优异,准确率、精确率和F1分数均超过99%;在自建数据集上,eXtreme Gradient Boosting(XGB)模型达到99.32%准确率、99.53%精确率和99.43% F1分数。通过使用Shapley Additive Explanations(SHAP),发现最大数据包大小、平均包到达间隔时间和使用的TLS版本是全局模型解释中最关键的特征。此外,在两个数据集上,关键特征也被识别为个别流量样本的局部解释重要特征。这些发现加深了对模型决策过程的理解,提升了检测加密恶意流量的透明性与可靠性。
原文摘要 · Abstract (English)
Encrypted network communication ensures confidentiality, integrity, and privacy between endpoints. However, attackers are increasingly exploiting encryption to conceal malicious behavior. Detecting unknown encrypted malicious traffic without decrypting the payloads remains a significant challenge. In this study, we investigate the integration of explainable artificial intelligence (XAI) techniques to detect malicious network traffic. We employ ensemble learning models to identify malicious activity using multi-view features extracted from various aspects of encrypted communication. To effectively represent malicious communication, we compiled a robust dataset with 1,127 unique connections, more than any other available open-source dataset, and spanning 54 malware families. Our models were benchmarked against the CTU-13 dataset, achieving performance of over 99% accuracy, precision, and F1-score. Additionally, the eXtreme Gradient Boosting (XGB) model demonstrated 99.32% accuracy, 99.53% precision, and 99.43% F1-score on our custom dataset. By leveraging Shapley Additive Explanations (SHAP), we identified that the maximum packet size, mean inter-arrival time of packets, and transport layer security version used are the most critical features for the global model explanation. Furthermore, key features were identified as important for local explanations across both datasets for individual traffic samples. These insights provide a deeper understanding of the model decision-making process, enhancing the transparency and reliability of detecting malicious encrypted traffic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。