对比VAE与ViT编码器在物联网僵尸网络检测中的表现
Impact of Latent Space Dimension on IoT Botnet Detection Performance: VAE-Encoder Versus ViT-Encoder
- 用VAE和ViT编码器将高维物联网流量数据压缩到不同维度的隐空间
- VAE在两个数据集上各项指标均优于ViT,最高准确率达98.7%
- 适合关注深度学习特征提取效率与模型适配性的安全研究人员
物联网技术的快速发展导致设备数量激增,使其成为各类网络攻击(尤其是僵尸网络)的主要目标。本研究探讨了隐空间维度对基于深度学习分类器性能的影响,比较了两种前沿架构——视觉变换器(ViT)与变分自编码器(VAE)——作为编码器时,将高维结构化.csv物联网僵尸网络流量数据映射至低维隐空间的效果。实验在N-BaIoT和CICIoT2022数据集上进行,结果表明:无论采用何种分类模型,使用VAE编码器生成的隐向量在准确率、精确率、召回率和F1分数四项指标上均显著优于ViT编码器。这一差异可归因于数据集中缺乏图像类的空间模式,而ViT模型依赖于此类模式进行特征学习。最终结果显示,对于非图像类的物联网流量数据,VAE更适合作为降维编码器。
原文摘要 · Abstract (English)
The rapid evolution of Internet of Things (IoT) technology has led to a significant increase in the number of IoT devices, applications, and services. This surge in IoT devices, along with their widespread presence, has made them a prime target for various cyber-attacks, particularly through IoT botnets. As a result, security has become a major concern within the IoT ecosystem. This study focuses on investigating how the latent dimension impacts the performance of different deep learning classifiers when trained on latent vector representations of the train dataset. The primary objective is to compare the outcomes of these models when encoder components from two cutting-edge architectures: the Vision Transformer (ViT) and the Variational Auto-Encoder (VAE) are utilized to project the high dimensional train dataset to the learned low dimensional latent space. The encoder components are employed to project high-dimensional structured .csv IoT botnet traffic datasets to various latent sizes. Evaluated on N-BaIoT and CICIoT2022 datasets, findings reveal that VAE-encoder based dimension reduction outperforms ViT-encoder based dimension reduction for both datasets in terms of four performance metrics including accuracy, precision, recall, and F1-score for all models which can be attributed to absence of spatial patterns in the datasets the ViT model attempts to learn and extract from image instances.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。