arXiv:2506.17041cs.LGcs.AI2025-06被引 3

用真实网络流量构建检测基准,揭示模型随时间退化问题

MAWIFlow Benchmark: Realistic Flow-Based Evaluation for Network Intrusion Detection

  • 基于真实跨太平洋流量构建时序分明的检测数据集
  • 树模型在静态数据表现好,但随时间推移性能显著下降
  • CNN-BiLSTM模型更稳定,适合长期部署的入侵检测

网络入侵检测的基准数据集通常依赖合成流量,无法反映实际环境中的统计变化和时间漂移。本文提出MAWIFlow,基于MAWILAB v1.1数据集构建流级别基准,支持真实、可复现的异常检测评估。提供可复现的预处理流程,将原始包捕获转化为符合CICFlowMeter格式的流表示,同时保留原数据集的异常标签。数据集包含2011年、2016年和2021年三个时间点的样本,来自跨太平洋骨干网流量。为建立基线,比较了决策树、随机森林、XGBoost、逻辑回归等传统机器学习方法与基于CNN-BiLSTM的深度学习模型。实验表明,树模型在静态数据上表现良好,但在时间跨度上性能显著下降;而CNN-BiLSTM模型保持更优的泛化能力。结果凸显合成基准和静态模型的局限性,强调采用具有明确时间结构的真实数据集的重要性。所有数据集、预处理代码和模型实现均已公开,以促进透明性和可复现性。

原文摘要 · Abstract (English)

Benchmark datasets for network intrusion detection commonly rely on synthetically generated traffic, which fails to reflect the statistical variability and temporal drift encountered in operational environments. This paper introduces MAWIFlow, a flow-based benchmark derived from the MAWILAB v1.1 dataset, designed to enable realistic and reproducible evaluation of anomaly detection methods. A reproducible preprocessing pipeline is presented that transforms raw packet captures into flow representations conforming to the CICFlowMeter format, while preserving MAWILab's original anomaly labels. The resulting datasets comprise temporally distinct samples from January 2011, 2016, and 2021, drawn from trans-Pacific backbone traffic. To establish reference baselines, traditional machine learning methods, including Decision Trees, Random Forests, XGBoost, and Logistic Regression, are compared to a deep learning model based on a CNN-BiLSTM architecture. Empirical results demonstrate that tree-based classifiers perform well on temporally static data but experience significant performance degradation over time. In contrast, the CNN-BiLSTM model maintains better performance, thus showing improved generalization. These findings underscore the limitations of synthetic benchmarks and static models, and motivate the adoption of realistic datasets with explicit temporal structure. All datasets, pipeline code, and model implementations are made publicly available to foster transparency and reproducibility.

入侵检测真实数据时序建模可复现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。