传统机器学习在内存样本恶意软件分类中表现优于深度模型。
Malware Classification from Memory Dumps Using Machine Learning, Transformers, and Large Language Models
- 用特征选择提升性能,XGB在45个关键特征上达87.42%准确率
- 深度学习模型表现较差,Transformer仅达71.59%准确率
- 适合关注特征工程与轻量级建模的网络安全研究者
本研究评估了多种分类模型在恶意软件分类任务中的表现,使用不同特征集和数据配置。六种传统模型(逻辑回归、KNN、SVM、决策树、随机森林、XGB)与两种深度学习模型(RNN、Transformer)及Gemini零样本和少样本学习方法被对比。测试了四种特征集:全特征、文献特征、随机森林选出的前45个特征、降采样后的前45个特征。XGB在前45个特征上取得最高准确率87.42%,紧随其后的是随机森林(87.23%)。深度学习模型表现较差,RNN为66.71%,Transformer为71.59%。降采样导致所有模型性能下降,XGB降至81.31%。Gemini零样本和少样本方法准确率最低,分别为40.65%和48.65%。结果表明特征选择对提升性能与降低计算开销至关重要。传统模型如XGB和随机森林表现更优,而深度学习与少样本方法未能达到同等水平。研究证实传统机器学习在结构化数据上的有效性,并为未来混合方法与更大数据集研究奠定基础。
原文摘要 · Abstract (English)
This study investigates the performance of various classification models for a malware classification task using different feature sets and data configurations. Six models-Logistic Regression, K-Nearest Neighbors (KNN), Support Vector Machines (SVM), Decision Trees, Random Forest (RF), and Extreme Gradient Boosting (XGB)-were evaluated alongside two deep learning models, Recurrent Neural Networks (RNN) and Transformers, as well as the Gemini zero-shot and few-shot learning methods. Four feature sets were tested including All Features, Literature Review Features, the Top 45 Features from RF, and Down-Sampled with Top 45 Features. XGB achieved the highest accuracy of 87.42% using the Top 45 Features, outperforming all other models. RF followed closely with 87.23% accuracy on the same feature set. In contrast, deep learning models underperformed, with RNN achieving 66.71% accuracy and Transformers reaching 71.59%. Down-sampling reduced performance across all models, with XGB dropping to 81.31%. Gemini zero-shot and few-shot learning approaches showed the lowest performance, with accuracies of 40.65% and 48.65%, respectively. The results highlight the importance of feature selection in improving model performance while reducing computational complexity. Traditional models like XGB and RF demonstrated superior performance, while deep learning and few-shot methods struggled to match their accuracy. This study underscores the effectiveness of traditional machine learning models for structured datasets and provides a foundation for future research into hybrid approaches and larger datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。