对比8种模型在恶意软件检测中的表现,发现提升性能的关键是选对模型和预处理方式。
Evaluating Ensemble and Deep Learning Models for Static Malware Detection with Dimensionality Reduction Using the EMBER Dataset
- 用PCA和LDA降维,测试8种机器学习模型在PE文件上的分类效果。
- LightGBM和XGBoost在所有设置下表现最佳,准确率超98%,对降维不敏感。
- 降维对不同模型影响差异大,需根据模型类型谨慎选择,避免性能下降。
本研究基于EMBER数据集,评估了八种分类模型(LightGBM、XGBoost、CatBoost、Random Forest、Extra Trees、HistGradientBoosting、KNN、TabNet)在静态恶意软件检测中的表现,采用原始特征空间、主成分分析(PCA)和线性判别分析(LDA)三种预处理方式。通过准确率、精确率、召回率、F1分数和AUC指标评估模型性能与鲁棒性。结果显示,集成方法尤其是LightGBM和XGBoost在所有配置下表现最优,对PCA降维不敏感且泛化能力强;而LDA虽提升了KNN性能,但显著降低了提升模型的准确率。尽管理论上有潜力,TabNet在特征降维后表现不佳,可能因其对输入结构敏感。研究还通过探索性数据分析(包括互信息排序、PCA/t-SNE可视化及孤立森林与局部离群因子检测)验证了关键特征的区分能力。结果表明,提升模型仍是高维静态恶意软件检测的可靠选择,降维应依据模型类型选择性应用。该工作为恶意软件检测中的模型与预处理策略比较提供了基准,并为未来系统开发与实际部署提供指导。
原文摘要 · Abstract (English)
This study investigates the effectiveness of several machine learning algorithms for static malware detection using the EMBER dataset, which contains feature representations of Portable Executable (PE) files. We evaluate eight classification models: LightGBM, XGBoost, CatBoost, Random Forest, Extra Trees, HistGradientBoosting, k-Nearest Neighbors (KNN), and TabNet, under three preprocessing settings: original feature space, Principal Component Analysis (PCA), and Linear Discriminant Analysis (LDA). The models are assessed on accuracy, precision, recall, F1 score, and AUC to examine both predictive performance and robustness. Ensemble methods, especially LightGBM and XGBoost, show the best overall performance across all configurations, with minimal sensitivity to PCA and consistent generalization. LDA improves KNN performance but significantly reduces accuracy for boosting models. TabNet, while promising in theory, underperformed under feature reduction, likely due to architectural sensitivity to input structure. The analysis is supported by detailed exploratory data analysis (EDA), including mutual information ranking, PCA or t-SNE visualizations, and outlier detection using Isolation Forest and Local Outlier Factor (LOF), which confirm the discriminatory capacity of key features in the EMBER dataset. The results suggest that boosting models remain the most reliable choice for high-dimensional static malware detection, and that dimensionality reduction should be applied selectively based on model type. This work provides a benchmark for comparing classification models and preprocessing strategies in malware detection tasks and contributes insights that can guide future system development and real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。