arXiv:2601.21323cs.LGcs.AI2026-01

手写特征的机器学习模型也易受神经网络攻击,且效果不亚于神经网络间攻击。

Adversarial Vulnerability Transcends Computational Paradigms: Feature Engineering Provides No Defense Against Neural Adversarial Transfer

  • 用VGG16生成对抗样本,测试其能否攻破传统特征模型
  • 所有经典模型准确率下降16.6%至59.1%,与神经网络间攻击相当
  • 快速梯度法比迭代攻击更有效,说明迭代攻击过拟合了特定特征

深度神经网络对对抗样本敏感——微小扰动即可导致误分类。尽管神经网络内部的对抗迁移已被广泛研究,但基于手工特征的经典机器学习流程在通过神经网络代理攻击时是否同样脆弱仍未知。特征工程通过梯度量化和空间分箱形成信息瓶颈,可能过滤高频对抗信号。我们首次系统评估了从深度神经网络到基于HOG的分类器的对抗迁移。以VGG16为代理,生成FGSM和PGD对抗样本,测试其在四个经典分类器(KNN、决策树、线性SVM、核SVM)及浅层神经网络上,八种HOG配置下的迁移效果。结果强烈反驳保护假设:所有分类器准确率下降16.6%至59.1%,与神经网络间迁移相当。更意外的是发现攻击层级反转——与神经网络中迭代攻击优于快速梯度法不同,在经典模型中,FGSM造成更大破坏,100%情况下超过PGD,表明迭代攻击过拟合代理特有特征而无法通过特征提取保留。块归一化提供部分但不足的缓解。这些发现表明,对抗脆弱性并非端到端可微性的产物,而是图像分类系统的根本属性,对跨计算范式的安全关键部署具有深远影响。

原文摘要 · Abstract (English)

Deep neural networks are vulnerable to adversarial examples--inputs with imperceptible perturbations causing misclassification. While adversarial transfer within neural networks is well-documented, whether classical ML pipelines using handcrafted features inherit this vulnerability when attacked via neural surrogates remains unexplored. Feature engineering creates information bottlenecks through gradient quantization and spatial binning, potentially filtering high-frequency adversarial signals. We evaluate this hypothesis through the first comprehensive study of adversarial transfer from DNNs to HOG-based classifiers. Using VGG16 as a surrogate, we generate FGSM and PGD adversarial examples and test transfer to four classical classifiers (KNN, Decision Tree, Linear SVM, Kernel SVM) and a shallow neural network across eight HOG configurations on CIFAR-10. Our results strongly refute the protective hypothesis: all classifiers suffer 16.6%-59.1% relative accuracy drops, comparable to neural-to-neural transfer. More surprisingly, we discover attack hierarchy reversal--contrary to patterns where iterative PGD dominates FGSM within neural networks, FGSM causes greater degradation than PGD in 100% of classical ML cases, suggesting iterative attacks overfit to surrogate-specific features that don't survive feature extraction. Block normalization provides partial but insufficient mitigation. These findings demonstrate that adversarial vulnerability is not an artifact of end-to-end differentiability but a fundamental property of image classification systems, with implications for security-critical deployments across computational paradigms.

对抗样本特征工程迁移攻击安全性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。