用注意力图指导图像裁剪,提升模型泛化能力
CAM-Guided Saliency Cutout and Image-Based Malware Classification
- 基于高分辨率注意力图选择重要区域进行裁剪
- 自然图像上性能微升,恶意软件图像上反而下降
- 揭示了恶意软件与自然图像在数据增强上的本质差异
Dropout正则化常通过训练时移除神经网络部分结构来减少过拟合。对于卷积神经网络(CNN),Cutout可实现类似效果:保留原始训练图像,生成带区域删除的增强副本。本文测试是否可用高分辨率类激活映射(HiResCAM)优化裁剪位置。对比四种训练条件:无裁剪、随机裁剪、低显著性裁剪和高显著性裁剪。实验使用灰度恶意软件图像(RawMal-TF数据集,17类,每类约1000样本)和经典自然图像数据集CIFAR-100,均基于ResNet18,约100个训练周期。裁剪区域大小设为~5%、10%、20%、30%,每张原图生成~M∈{4,8}个增强副本。结果表明,所有三种裁剪方式(随机、高显著性、低显著性)在RawMal-TF上表现均劣于无裁剪;而在CIFAR-100上,低显著性裁剪略有提升。说明显著性引导裁剪的价值具有领域依赖性,恶意软件图像不可等同于自然图像处理。
原文摘要 · Abstract (English)
Dropout regularization is commonly used to reduce overfitting by removing parts of a neural network during training. For Convolutional Neural Networks (CNN), cutouts serve a somewhat analogous purpose. Cutouts can be implemented as data augmentation: the original training image is retained, and additional copies are created with regions removed. In this chapter, we test whether cutout placement can be improved by using High-Resolution Class Activation Mapping (HiResCAM). We compare four controlled training conditions: no cutout, standard random cutout, low-saliency cutout, and high-saliency cutout. We experiment using grayscale malware images from the RawMal-TF dataset (17 families with~1,000 samples per family), and for comparison to natural images, we experiment with the well-known CIFAR-100 dataset. All experiments are based on ResNet18 with~100 training epochs. For the cutout experiments, we test cutout areas of~5\%, 10\%, 20\%, and~30\%, and we consider~$M\in\{4,8}$ augmented copies per original training image. The RawMal-TF results are slightly worse for all three cutout cases (random, high and low saliency) as compared to no cutouts. In contrast, our CIFAR-100 experimental results improve slightly under low-saliency cutout. These results suggest that the value of saliency-guided cutout is domain dependent, and that malware images should not be treated as equivalent to natural images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。