用自监督学习让模型从少量样本中识别未知恶意软件。
Packet Inspection Transformer: A Self-Supervised Journey to Unseen Malware Detection with Few Samples
- 用掩码自监督训练变压器,从无标签数据学包内容表征。
- 在UNSW-NB15上达94.76%准确率,CIC-IoT23上达83.25%。
- 适合缺乏标注数据的新型恶意软件检测场景。
随着网络不断扩展和互联,新型恶意软件检测方法的需求日益迫切。传统安全措施难以应对现代网络攻击的复杂性。深度包检测(DPI)通过分析包头元数据和实际载荷内容,提供了超越传统监控的全面流量视图。尽管深度学习与DPI结合已推动恶意软件检测的发展,但现有监督学习方法依赖大量标注数据,且难以泛化到新出现的恶意威胁。为此,本文融合自监督学习(SSL)与少样本学习(FSL),提出一种自监督框架:利用海量无标签数据,通过掩码部分包内容训练变压器,学习通用包内容表征;再基于该表征,采用少样本学习策略适应新型攻击。实验表明,在UNSW-NB15数据集上分类准确率达94.76%,在CIC-IoT23数据集上达83.25%。
原文摘要 · Abstract (English)
As networks continue to expand and become more interconnected, the need for novel malware detection methods becomes more pronounced. Traditional security measures are increasingly inadequate against the sophistication of modern cyber attacks. Deep Packet Inspection (DPI) has been pivotal in enhancing network security, offering an in-depth analysis of network traffic that surpasses conventional monitoring techniques. DPI not only examines the metadata of network packets, but also dives into the actual content being carried within the packet payloads, providing a comprehensive view of the data flowing through networks. While the integration of advanced deep learning techniques with DPI has introduced modern methodologies into malware detection and network traffic classification, state-of-the-art supervised learning approaches are limited by their reliance on large amounts of annotated data and their inability to generalize to novel, unseen malware threats. To address these limitations, this paper leverages the recent advancements in self-supervised learning (SSL) and few-shot learning (FSL). Our proposed self-supervised approach trains a transformer via SSL to learn the embedding of packet content, including payload, from vast amounts of unlabeled data by masking portions of packets, leading to a learned representation that generalizes to various downstream tasks. Once the representation is extracted from the packets, they are used to train a malware detection algorithm. The representation obtained from the transformer is then used to adapt the malware detector to novel types of attacks using few-shot learning approaches. Our experimental results demonstrate that our method achieves classification accuracies of up to 94.76% on the UNSW-NB15 dataset and 83.25% on the CIC-IoT23 dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。