量化技术让轻量级网络检测模型在物联网设备上高效运行。
A Quantized VAE-MLP Botnet Detection Model: A Systematic Evaluation of Quantization-Aware Training and Post-Training Quantization Strategies
- 用变分自编码器提取特征,再用MLP分类,结合量化压缩模型。
- 后训练量化使模型体积缩小21倍,速度提升6倍,精度损失极小。
- 适合资源受限的物联网设备部署,尤其关注实时检测场景。
为应对日益增多的物联网僵尸网络攻击,现有深度学习方法虽实现高检测准确率,但计算开销大,难以在资源受限的IoT设备上部署。本文提出一种基于VAE-MLP的模型框架:先用预训练变分自编码器(VAE)将高维数据编码为8维潜在向量,再由基于MLP的分类器进行训练。系统评估了两种量化策略——量化感知训练(QAT)与后训练量化(PTQ)在两个基准数据集N-BaIoT和CICIoT2022上的表现,包括检测性能、存储效率和推理延迟。结果表明,相较于未量化模型,QAT导致精度明显下降,而PTQ仅造成微小损失;同时,PTQ实现6倍加速与21倍体积压缩,QAT实现3倍加速与24倍压缩,验证了量化技术在设备端物联网僵尸网络检测中的实用性。
原文摘要 · Abstract (English)
In an effort to counter the increasing IoT botnet-based attacks, state-of-the-art deep learning methods have been proposed and have achieved impressive detection accuracy. However, their computational intensity restricts deployment on resource-constrained IoT devices, creating a critical need for lightweight detection models. A common solution to this challenge is model compression via quantization. This study proposes a VAE-MLP model framework where an MLP-based classifier is trained on 8-dimensional latent vectors derived from the high-dimensional train data using the encoder component of a pretrained variational autoencoder (VAE). Two widely used quantization strategies--Quantization-Aware Training (QAT) and Post-Training Quantization (PTQ)--are then systematically evaluated in terms of their impact on detection performance, storage efficiency, and inference latency using two benchmark IoT botnet datasets--N-BaIoT and CICIoT2022. The results revealed that, with respect to detection accuracy, the QAT strategy experienced a more noticeable decline,whereas PTQ incurred only a marginal reduction compared to the original unquantized model. Furthermore, PTQ yielded a 6x speedup and 21x reduction in size, while QAT achieved a 3x speedup and 24x compression, demonstrating the practicality of quantization for device-level IoT botnet detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。