提出TriQDef防御量化网络中攻击补丁的跨位宽迁移问题
TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks
- 通过三层次量化感知框架,破坏语义与梯度对齐
- 在未见组合下使攻击成功率降低超40%
- 适合部署在资源受限设备的对抗鲁棒性需求
量化神经网络(QNNs)因计算与内存效率高,被广泛用于边缘和资源受限环境。尽管其能扭曲梯度空间并削弱常规像素级攻击,但对基于补丁的对抗攻击——即局部高显著性扰动——仍存在跨位宽迁移性,防护能力有限。现有防御方法或过度依赖固定量化设置,或无法解决此跨位宽泛化漏洞。本文提出 extbf{TriQDef},一种三层次量化感知防御框架,旨在破坏补丁类对抗攻击在不同量化网络间的可迁移性。该框架包含:(1) 特征错位惩罚(FDP),通过惩罚中间表示的感知相似性以强制语义不一致;(2) 梯度感知失调惩罚(GPDP),利用边缘交并比(Edge IoU)与方向余弦(HOG Cosine)指标最小化输入梯度在不同位宽间的结构与方向一致性;(3) 联合量化感知训练协议,在共享权重框架下统一多量化层级的惩罚机制。在CIFAR-10与ImageNet上的大量实验表明,TriQDef在未见过的补丁与量化组合下,攻击成功率(ASR)降低超过40%,同时保持高原始准确率。研究结果强调,需同时破坏语义与感知梯度对齐,才能有效缓解QNN中的补丁迁移性问题。
原文摘要 · Abstract (English)
Quantized Neural Networks (QNNs) are increasingly deployed in edge and resource-constrained environments due to their efficiency in computation and memory usage. While shown to distort the gradient landscape and weaken conventional pixel-level attacks, it provides limited robustness against patch-based adversarial attacks-localized, high-saliency perturbations that remain surprisingly transferable across bit-widths. Existing defenses either overfit to fixed quantization settings or fail to address this cross-bit generalization vulnerability. We introduce \textbf{TriQDef}, a tri-level quantization-aware defense framework designed to disrupt the transferability of patch-based adversarial attacks across QNNs. TriQDef consists of: (1) a Feature Disalignment Penalty (FDP) that enforces semantic inconsistency by penalizing perceptual similarity in intermediate representations; (2) a Gradient Perceptual Dissonance Penalty (GPDP) that explicitly misaligns input gradients across bit-widths by minimizing structural and directional agreement via Edge IoU and HOG Cosine metrics; and (3) a Joint Quantization-Aware Training Protocol that unifies these penalties within a shared-weight training scheme across multiple quantization levels. Extensive experiments on CIFAR-10 and ImageNet demonstrate that TriQDef reduces Attack Success Rates (ASR) by over 40\% on unseen patch and quantization combinations, while preserving high clean accuracy. Our findings underscore the importance of disrupting both semantic and perceptual gradient alignment to mitigate patch transferability in QNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。