arXiv:2511.08345cs.CRcs.LG2025-11

通过重处理原始数据提升物联网流量特征质量,增强模型检测攻击的泛化能力。

Revisiting Network Traffic Analysis: Compatible network flows for ML models

  • 用HERA工具解析PCAP包生成新标注流,统一特征提取标准。
  • 新特征训练的集成树模型在多个数据集上检测准确率显著提升。
  • 适合做网络安全模型评估的研究者和数据预处理工程师参考。

为确保机器学习模型能有效检测和分类网络攻击,需使用高质量、具代表性的数据集。然而,在物联网(IoT)网络中,攻击流量模式复杂,难以准确建模。本文研究了不同流量导出工具生成的看似相似特征对模型泛化性和鲁棒性的影响。基于Bot-IoT、IoT-23和CICIoT23数据集的原始PCAP文件,使用HERA工具分析并生成新的标注流量,提取一致特征构建新版CSV文件。将这些新数据与原始CSV对比,并用于微调多种模型。结果表明,直接分析和预处理PCAP文件,而非仅使用常见CSV文件,可计算出更相关特征,从而提升袋装和梯度提升决策树集成模型的性能。持续优化特征提取与选择流程,有助于提高不同数据集间的兼容性,实现对网络安全领域机器学习模型的可信评估与比较。

原文摘要 · Abstract (English)

To ensure that Machine Learning (ML) models can perform a robust detection and classification of cyberattacks, it is essential to train them with high-quality datasets with relevant features. However, it can be difficult to accurately represent the complex traffic patterns of an attack, especially in Internet-of-Things (IoT) networks. This paper studies the impact that seemingly similar features created by different network traffic flow exporters can have on the generalization and robustness of ML models. In addition to the original CSV files of the Bot-IoT, IoT-23, and CICIoT23 datasets, the raw network packets of their PCAP files were analysed with the HERA tool, generating new labelled flows and extracting consistent features for new CSV versions. To assess the usefulness of these new flows for intrusion detection, they were compared with the original versions and were used to fine-tune multiple models. Overall, the results indicate that directly analysing and preprocessing PCAP files, instead of just using the commonly available CSV files, enables the computation of more relevant features to train bagging and gradient boosting decision tree ensembles. It is important to continue improving feature extraction and feature selection processes to make different datasets more compatible and enable a trustworthy evaluation and comparison of the ML models used in cybersecurity solutions.

网络流量特征工程入侵检测IoT安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。