用强化学习动态选特征,检测病毒又快又准。
Adaptive Malware Detection using Sequential Feature Selection: A Dueling Double Deep Q-Network (D3QN) Framework for Intelligent Classification
- 用D3QN框架逐步挑选关键特征,边选边判断。
- 准确率达99.2%和98.8%,平均只用61和56个特征。
- 适合需要实时检测的安防系统,可大幅降算力。
传统恶意软件检测方法因需穷举特征提取而效率低下,导致准确率与计算成本难以兼顾,限制了实时部署。本文将恶意软件分类建模为马尔可夫决策过程,引入基于双延迟深度Q网络(D3QN)的自适应序列特征选择框架。智能体在每样本上动态选择信息量高的特征,在终止时完成分类决策,通过强化学习同时优化检测准确率与计算开销。在Microsoft Big2015(9类,1,795维)与BODMAS(二分类,2,381维)数据集上验证,D3QN分别实现99.22%与98.83%准确率,平均仅使用61与56个特征,维度降低达96.6%与97.6%。相较传统集成方法,计算效率提升30.1倍与42.5倍。消融实验表明其持续优于随机森林、XGBoost及静态特征选择方法。定量分析显示,其特征选择策略偏离均匀分布62.5%,呈现分层结构:先利用高层元数据评估,再依据分类不确定性选择行为特征。特征专属性分析发现57.7%的特征表现出显著类别区分模式。结果验证了强化学习驱动的序列特征选择在恶意软件分类中的有效性,实现高精度与大幅计算节省。
原文摘要 · Abstract (English)
Traditional malware detection methods exhibit computational inefficiency due to exhaustive feature extraction requirements, creating accuracy-efficiency trade-offs that limit real-time deployment. We formulate malware classification as a Markov Decision Process with episodic feature acquisition and propose a Dueling Double Deep Q-Network (D3QN) framework for adaptive sequential feature selection. The agent learns to dynamically select informative features per sample before terminating with classification decisions, optimizing both detection accuracy and computational cost through reinforcement learning. We evaluate our approach on Microsoft Big2015 (9-class, 1,795 features) and BODMAS (binary, 2,381 features) datasets. D3QN achieves 99.22% and 98.83% accuracy while utilizing only 61 and 56 features on average, representing 96.6% and 97.6% dimensionality reduction. This yields computational efficiency improvements of 30.1x and 42.5x over traditional ensemble methods. Comprehensive ablation studies demonstrate consistent superiority over Random Forest, XGBoost, and static feature selection approaches. Quantitative analysis demonstrates that D3QN learns non-random feature selection policies with 62.5% deviation from uniform baseline distributions. The learned policies exhibit structured hierarchical preferences, utilizing high-level metadata features for initial assessment while selectively incorporating detailed behavioral features based on classification uncertainty. Feature specialization analysis reveals 57.7% of examined features demonstrate significant class-specific discrimination patterns. Our results validate reinforcement learning-based sequential feature selection for malware classification, achieving superior accuracy with substantial computational reduction through learned adaptive policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。