arXiv:2508.18839cs.LGcs.CR2025-08AAAI被引 10

用强化学习动态识别恶意软件,自动决定何时交给人工判断。

DRMD: Deep Reinforcement Learning for Malware Detection under Concept Drift

  • 将恶意软件检测建模为马尔可夫决策过程,用深度强化学习同时优化分类与拒判。
  • 在多时间跨度的安卓恶意软件数据集上,检测性能提升8.66至10.90(AUT指标)。
  • 适合需要长期稳定检测能力的工业级安全系统部署。

真实世界中的恶意软件检测需应对持续演变的威胁、有限标注预算及预测不确定性。传统分类器因缺乏决策延迟机制,在概念漂移下难以维持性能。现有方案结合主动学习与拒判机制,但未实现最优权衡。本文提出一种基于深度强化学习的恶意软件检测框架(DRMD),将检测过程建模为单步马尔可夫决策过程,训练智能体同步优化分类准确率与高风险样本拒判策略。在涵盖多年变化的安卓恶意软件数据集上进行时间感知评估,结果表明:相比标准分类方法,该框架在仅分类和分类-拒判两种策略下,平均面积随时间(AUT)分别提升8.66和10.90,显著增强对概念漂移的鲁棒性。首次证明强化学习可在动态安卓恶意软件环境中实现高效检测与自适应抗漂移能力。

原文摘要 · Abstract (English)

Malware detection in real-world settings must deal with evolving threats, limited labeling budgets, and uncertain predictions. Traditional classifiers, without additional mechanisms, struggle to maintain performance under concept drift in malware domains, as their supervised learning formulation cannot optimize when to defer decisions to manual labeling and adaptation. Modern malware detection pipelines combine classifiers with monthly active learning (AL) and rejection mechanisms to mitigate the impact of concept drift. In this work, we develop a novel formulation of malware detection as a one-step Markov Decision Process and train a deep reinforcement learning (DRL) agent, simultaneously optimizing sample classification performance and rejecting high-risk samples for manual labeling. We evaluated the joint detection and drift mitigation policy learned by the DRL-based Malware Detection (DRMD) agent through time-aware evaluations on Android malware datasets subject to realistic drift requiring multi-year performance stability. The policies learned under these conditions achieve a higher Area Under Time (AUT) performance compared to standard classification approaches used in the domain, showing improved resilience to concept drift. Specifically, the DRMD agent achieved an average AUT improvement of 8.66 and 10.90 for the classification-only and classification-rejection policies, respectively. Our results demonstrate for the first time that DRL can facilitate effective malware detection and improved resiliency to concept drift in the dynamic setting of Android malware detection.

恶意软件检测强化学习概念漂移DRL

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。