用自动学习特征提升网络入侵检测,实测效果依赖数据集和模型选择。
Evaluating Tabular Representation Learning for Network Intrusion Detection

- 用表格式表示学习自动提取NetFlow特征,替代人工设计。
- 监督分类表现远超无监督检测,但最佳方法因数据集而异。
- 跨数据集迁移可行,但效果受网络环境差异影响大。
传统网络入侵检测系统(NIDS)依赖人工特征工程从网络流量中提取有意义模式,这需要领域知识且违背现代机器学习让模型直接从数据学习表示的原则。本文研究表格式表示学习技术能否通过自动学习鲁棒特征表示来提升入侵检测性能。系统评估了前沿表示学习方法在基准NetFlow数据集上的表现,对比传统自编码器与端到端Transformer基线。使用监督分类器和无监督异常检测器对学习到的表示进行评估,并对每种组合进行全面超参数调优。结果揭示显著的数据集-模型依赖性,无单一方法在所有场景中持续领先。在监督分类任务中,TabICL在CIDDS数据集上表现最优,自编码器紧随其后,且与端到端Transformer模型在平均排名上并列最佳。监督方法显著优于无监督异常检测,但无固定最优组合,选择取决于具体数据集。跨数据集迁移实验表明,适当的方法与分类器组合下,学习到的表示可在不同网络环境中泛化,但迁移效果因源-目标数据集组合差异而大幅波动,说明对网络环境分布差异敏感。
原文摘要 · Abstract (English)
Classic Network Intrusion Detection Systems (NIDS) often rely on manual feature engineering to extract meaningful patterns from network traffic data. However, this approach requires domain expertise and runs counter to the widely adopted principle of modern machine learning and neural networks: that models themselves should learn meaningful representations directly from data. We investigate whether tabular representation learning techniques can improve intrusion detection performance by automatically learning robust feature representations for NetFlow data. This paper presents a systematic evaluation of state-of-the-art representation learning methods on benchmark NetFlow datasets, comparing against traditional autoencoders and end-to-end transformer baselines. We evaluate learned representations using both supervised classifiers and unsupervised anomaly detectors, with comprehensive hyperparameter exploration for each combination. Our results reveal strong dataset-model dependency, with no single approach consistently dominating across all scenarios. For supervised classification, TabICL achieves the best performance on CIDDS, while autoencoders follow closely and tie with end-to-end transformer models for the best average rank across datasets. Supervised approaches substantially outperform unsupervised anomaly detection methods, where no single combination consistently dominates as optimal choices depend on the dataset. Cross-dataset transfer experiments demonstrate that learned representations can generalize across network environments with appropriate method and classifier selection. However, transfer performance varies substantially depending on the source-target dataset combination, indicating sensitivity to distributional differences between network environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。