用GAN和SMOTE生成对抗样本,暴露出文本与人脸识别模型的严重漏洞。
Undermining Image and Text Classification Algorithms Using Adversarial Attacks
- 结合GAN与SMOTE生成对抗数据,攻击文本分类模型。
- 文本分类准确率下降20%,人脸识别准确率下降30%。
- 适合关注AI安全与防御的研究者参考。
机器学习模型易受对抗攻击影响,即通过微小输入扰动导致误分类。现有研究多聚焦于生成对抗网络(GANs),但对GAN与合成少数类过采样技术(SMOTE)在文本和图像分类模型中用于对抗攻击的探索有限。本研究通过训练多种机器学习模型,利用GAN和SMOTE生成额外数据点以攻击文本分类模型,并扩展至人脸识别模型:训练卷积神经网络(CNN),并基于GradCAM识别的关键特征,施加快速梯度符号法(FGSM)扰动进行攻击。实验表明,顶级文本分类模型准确率下降20%,人脸识别准确率下降30%,揭示了这些模型在输入数据被操纵时的显著脆弱性。对抗攻击不仅威胁系统安全,更动摇其可靠性。本研究凸显了发展鲁棒防御机制的紧迫性。
原文摘要 · Abstract (English)
Machine learning models are prone to adversarial attacks, where inputs can be manipulated in order to cause misclassifications. While previous research has focused on techniques like Generative Adversarial Networks (GANs), there's limited exploration of GANs and Synthetic Minority Oversampling Technique (SMOTE) in text and image classification models to perform adversarial attacks. Our study addresses this gap by training various machine learning models and using GANs and SMOTE to generate additional data points aimed at attacking text classification models. Furthermore, we extend our investigation to face recognition models, training a Convolutional Neural Network(CNN) and subjecting it to adversarial attacks with fast gradient sign perturbations on key features identified by GradCAM, a technique used to highlight key image characteristics CNNs use in classification. Our experiments reveal a significant vulnerability in classification models. Specifically, we observe a 20 % decrease in accuracy for the top-performing text classification models post-attack, along with a 30 % decrease in facial recognition accuracy. This highlights the susceptibility of these models to manipulation of input data. Adversarial attacks not only compromise the security but also undermine the reliability of machine learning systems. By showcasing the impact of adversarial attacks on both text classification and face recognition models, our study underscores the urgent need for develop robust defenses against such vulnerabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。