用生成模型主动选样本,让网络入侵检测更准且省人工。
Generative Active Adaptation for Drifting and Imbalanced Network Intrusion Detection
- 根据数据密度选最有价值样本,减少标注量。
- 稀有攻击检测F1从0提升至0.71,整体F1达0.86。
- 适合需要低成本更新的实时入侵检测场景。
机器学习在网络安全检测中表现良好,但受概念漂移和数据不平衡影响,性能常下降。标注网络流量耗时耗力,尤其对新出现或罕见攻击类型更难准备合适数据。为此,我们提出一种生成式主动适应框架 etguard,通过密度感知的数据集先验选择识别最需标注的样本,并利用深度生成模型条件合成多样化样本,扩充训练集以缓解概念漂移。我们在模拟数据和真实运营商(ISP)数据集上评估该框架,结果显示:在CIC-IDS 2018数据集上,整体F1分数从无适配时的0.60提升至0.86;罕见攻击如Infiltration、Web Attack、FTP-BruteForce的F1分别由0.001、0.04、0.00提升至0.30、0.50、0.71。该方法有效提升稀有攻击检测能力并降低标注成本,具备可扩展性和实用性。
原文摘要 · Abstract (English)
Machine learning has shown promise in network intrusion detection systems, yet its performance often degrades due to concept drift and imbalanced data. These challenges are compounded by the labor-intensive process of labeling network traffic, especially when dealing with evolving and rare attack types, which makes preparing the right data for adaptation difficult. To address these issues, we propose a generative active adaptation framework that minimizes labeling effort while enhancing model robustness. Our approach employs density-aware dataset prior selection to identify the most informative samples for annotation, and leverages deep generative models to conditionally synthesize diverse samples, thereby augmenting the training set and mitigating the effects of concept drift. We evaluate our end-to-end framework \NetGuard on both simulated IDS data and a real-world ISP dataset, demonstrating significant improvements in intrusion detection performance. Our method boosts the overall F1-score from 0.60 (without adaptation) to 0.86. Rare attacks such as Infiltration, Web Attack, and FTP-BruteForce, which originally achieved F1 scores of 0.001, 0.04, and 0.00, improve to 0.30, 0.50, and 0.71, respectively, with generative active adaptation in the CIC-IDS 2018 dataset. Our framework effectively enhances rare attack detection while reducing labeling costs, making it a scalable and practical solution for intrusion detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。