arXiv:2410.03952cs.LGcs.AI2024-10

用图像像素相似性替代神经数据,提升CNN抗攻击能力

Pixel-Based Similarities as an Alternative to Neural Data for Improving Convolutional Neural Network Adversarial Robustness

  • 用图像像素直接计算相似性,替代依赖神经数据的正则化方法
  • 在不使用神经记录的情况下,达到与神经数据相当的抗攻击效果
  • 方法轻量易集成,适合希望简化防御流程的研究者

卷积神经网络(CNN)在视觉任务中表现优异,但对不可察觉的对抗扰动仍敏感。以往研究发现,基于脑神经记录的正则化可增强CNN鲁棒性,但受限于专用数据难以推广。本文重新审视Li等(2019)提出的、使CNN表示与神经表征相似结构对齐的正则化方法,提出一种数据驱动变体:不再使用神经记录的相似性,而是直接从图像中计算像素级相似性。该方法保留了原始生物启发损失形式,同时消除了对神经测量或任务特定增强的依赖。实验表明,该变体在对抗鲁棒性上与使用神经数据时效果相当。该方法轻量且易于融入标准训练流程。虽未超越最先进专用防御方法,但证明了无需直接神经记录也可有效利用神经表征洞见。这凸显了基于脑启发原则的简单、鲁棒方法的巨大潜力,未来结合此类洞察或可逼近人类水平,而无需复杂专用流水线。

原文摘要 · Abstract (English)

Convolutional Neural Networks (CNNs) excel in many visual tasks but remain susceptible to adversarial attacks-imperceptible perturbations that degrade performance. Prior research reveals that brain-inspired regularizers, derived from neural recordings, can bolster CNN robustness; however, reliance on specialized data limits practical adoption. We revisit a regularizer proposed by Li et al. (2019) that aligns CNN representations with neural representational similarity structures and introduce a data-driven variant. Instead of a neural recording-based similarity, our method computes a pixel-based similarity directly from images. This substitution retains the original biologically motivated loss formulation, preserving its robustness benefits while removing the need for neural measurements or task-specific augmentations. Notably, this data-driven variant provides the same robustness improvements observed with neural data. Our approach is lightweight and integrates easily into standard pipelines. Although we do not surpass cutting-edge specialized defenses, we show that neural representational insights can be leveraged without direct recordings. This underscores the promise of robust yet simple methods rooted in brain-inspired principles, even without specialized data, and raises the possibility that further integrating these insights could push performance closer to human levels without resorting to complex, specialized pipelines.

对抗鲁棒性脑启发轻量方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。