arXiv:2606.12075cs.CRcs.LG2026-06

对比三种模型在攻击下的表现,发现高准确率不等于强抗扰性。

Categorical Robustness Assessment for Machine Learning based Network Intrusion Detection Systems

论文配图:Categorical Robustness Assessment for Machine Learning based Network Intrusion Detection Systems
图 1 · 摘自论文原文
  • 用FGSM和PGD攻击测试三种模型的鲁棒性
  • 随机森林基线99.98%但攻击下跌73个百分点
  • CNN在攻击下保持95.5%准确率,最稳健

网络入侵检测系统(NIDS)广泛使用机器学习,但模型可能受对抗攻击影响。本文通过在ACI-IoT-2023数据集(超120万样本,涵盖12类攻击)上对一维CNN、LSTM和随机森林(RF)三类架构进行测试,采用FGSM与PGD攻击,在ε=0.01至ε=0.1的扰动预算下评估其鲁棒性。结果显示,随机森林基线准确率达99.98%,但在ε=0.01时下降73个百分点;而CNN在相同条件下仍保持95.5%准确率,性能衰减平稳。LSTM表现居中。研究揭示高基线准确率无法保证抗攻击能力,建议在对抗环境下优先部署基于CNN的架构,并提供具体部署指导。

原文摘要 · Abstract (English)

Network Intrusion Detection Systems (NIDS) heavily utlize Machine Learning (ML) but ML models can be manipulated via adversarial attacks. These attacks add carefully crafted perturbations to network traffic data that leads to misclassifications. While prior work has demonstrated adversarial vulnerabilities in isolated settings, systematic cross-architecture as well as class and category of attack based comparisons under controlled attack conditions remain limited, leaving practitioners without clear guidance on which models to deploy in adversarial environments. This paper asks a simple question: what type of classifier architectures actually hold up when attackers try to manipulate the systems? We put three popular architectures through their paces: a 1D Convolutional Neural Network, a Long Short-Term Memory (LSTM) network, and a Random Forest (RF) ensemble. Using the ACI-IoT-2023 dataset (over 1.2 million samples spanning 12 attack types), we subject each model with FGSM and PGD adversarial attacks, which apply gradient-based perturbations in normalized feature space consistent with established adversarial ML evaluation protocols, at perturbation budgets ranging from $ε=0.01$ to $ε=0.1$. Surprisingly, Random Forest achieved near-perfect baseline accuracy (99.98\%), yet collapsed catastrophically under attack, dropping 73 percentage points at the smallest perturbation we tested. CNN, on the other hand, retained 95.5\% accuracy at $ε=0.01$ and degraded gracefully as perturbations increased. LSTM fell somewhere in between. These findings flip the conventional wisdom where high baseline accuracy means nothing if a model shatters at the first sign of adversarial pressure. For practitioners deploying intrusion detection in adversarial environments, we recommend CNN-based architectures and provide scenario-specific deployment guidance.

入侵检测对抗攻击模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。