arXiv:2502.14135cs.LGcs.CR2025-02被引 6

用聚类方法自动检测恶意软件数据漂移,提升分类模型持续有效性。

Cluster Analysis and Concept Drift Detection in Malware

  • 基于MiniBatch K-Means聚类与轮廓系数检测数据漂移点。
  • 漂移感知重训练使准确率接近周期重训,但效率远超后者。
  • 适合需要长期维护的恶意软件检测系统使用。

概念漂移指数据属性随时间发生渐进或突变,影响机器学习模型的准确性。本文针对恶意软件领域中的概念漂移检测问题,提出并分析一种基于聚类的方法。利用KronoDroid数据集的一个子集,将恶意软件样本按时间分批,采用MiniBatch K-Means聚类进行分析,以轮廓系数作为指标识别可能发生概念漂移的时间点。为验证结果,我们在三种现实场景下训练模型:静态训练、周期性重训练和漂移感知重训练。每种场景下测试四种分类器:多层感知机(MLP)、支持向量机(SVM)、随机森林(Random Forest)和XGBoost。实验表明,基于轮廓系数阈值的漂移感知重训练在分类准确率上远超静态模型,且通常仅比周期重训低1%以内,同时效率显著更高。结果有力证明了该聚类方法在检测概念漂移方面的有效性,并展示了一种高效、全自动的恶意软件分类优化方案。

原文摘要 · Abstract (English)

Concept drift refers to gradual or sudden changes in the properties of data that affect the accuracy of machine learning models. In this paper, we address the problem of concept drift detection in the malware domain. Specifically, we propose and analyze a clustering-based approach to detecting concept drift. Using a subset of the KronoDroid dataset, malware samples are partitioned into temporal batches and analyzed using MiniBatch $K$-Means clustering. The silhouette coefficient is used as a metric to identify points in time where concept drift has likely occurred. To verify our drift detection results, we train learning models under three realistic scenarios, which we refer to as static training, periodic retraining, and drift-aware retraining. In each scenario, we consider four supervised classifiers, namely, Multilayer Perceptron (MLP), Support Vector Machine (SVM), Random Forest, and XGBoost. Experimental results demonstrate that drift-aware retraining guided by silhouette coefficient thresholding achieves classification accuracy far superior to static models, and generally within 1% of periodic retraining, while also being far more efficient than periodic retraining. These results provide strong evidence that our clustering-based approach is effective at detecting concept drift, while also illustrating a highly practical and efficient fully automated approach to improved malware classification via concept drift detection.

恶意软件概念漂移聚类自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。