arXiv:2512.18495cs.CRcs.AI2025-12

用集成模型不确定性提升恶意软件分类在数据偏移下的可靠性。

Enhancing Decision-Making in Windows PE Malware Classification During Dataset Shifts with Uncertainty Estimation

  • 结合集成模型与置信度评估,改进鲁棒性决策策略。
  • 在UCSB数据集上误接受率从22.8%降至16%,降低约30%。
  • 适合关注实际安全场景中模型稳定性的研究者与工程师。

人工智能在识别Windows可移植可执行文件(PE)恶意软件方面表现优异,但在数据分布变化时可靠性下降,可能导致严重安全后果。本文通过引入神经网络、PriorNet及神经网络集成,增强现有LightGBM检测器,在EMBER、BODMAS和UCSB三个基准数据集上评估。其中UCSB以打包恶意软件为主,与其他数据集存在显著分布差异,构成强挑战。研究对比了概率阈值、PriorNet、集成估计与归纳型符合评估(ICE)等不确定性感知决策策略。主要贡献在于将集成模型的不确定性作为非一致性度量用于ICE,结合新型阈值优化方法。在最严峻的UCSB数据集上,现有最优概率型ICE的误接受率(IA%)为22.8%,而本方法将其降至16%,相对降低约30%,同时保持良好正确接受率(CA%)。结果表明,集成不确定性与符合预测结合可有效防范极端数据偏移下的误判,尤其适用于打包恶意软件场景,对实际安全运营具有实用价值。

原文摘要 · Abstract (English)

Artificial intelligence techniques have achieved strong performance in classifying Windows Portable Executable (PE) malware, but their reliability often degrades under dataset shifts, leading to misclassifications with severe security consequences. To address this, we enhance an existing LightGBM (LGBM) malware detector by integrating Neural Networks (NN), PriorNet, and Neural Network Ensembles, evaluated across three benchmark datasets: EMBER, BODMAS, and UCSB. The UCSB dataset, composed mainly of packed malware, introduces a substantial distributional shift relative to EMBER and BODMAS, making it a challenging testbed for robustness. We study uncertainty-aware decision strategies, including probability thresholding, PriorNet, ensemble-derived estimates, and Inductive Conformal Evaluation (ICE). Our main contribution is the use of ensemble-based uncertainty estimates as Non-Conformity Measures within ICE, combined with a novel threshold optimisation method. On the UCSB dataset, where the shift is most severe, the state-of-the-art probability-based ICE (SOTA) yields an incorrect acceptance rate (IA%) of 22.8%. In contrast, our method reduces this to 16% a relative reduction of about 30% while maintaining competitive correct acceptance rates (CA%). These results demonstrate that integrating ensemble-based uncertainty with conformal prediction provides a more reliable safeguard against misclassifications under extreme dataset shifts, particularly in the presence of packed malware, thereby offering practical benefits for real-world security operations.

恶意软件分类不确定性估计数据偏移符合预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。