arXiv:2606.13801cs.LGq-bio.NC2026-06

让人工神经网络引入有结构的随机性,能显著提升抗干扰能力。

Neural Variability Enhances Artificial Network Robustness

论文配图:Neural Variability Enhances Artificial Network Robustness
图 1 · 摘自论文原文
  • 用激活值的协方差设计有结构的噪声,模拟生物神经活动
  • 对自然图像修改的鲁棒性提升最明显,但跨类型迁移差
  • 对抗攻击产生的噪声结构可泛化到其他攻击类型,适合防御场景

皮层神经元在重复刺激下表现出显著的试次间变异,而外周感觉神经元响应更一致,引发人们对随机性是否具有意义的思考。已有研究认为噪声与信号相关性可在动物中优化区分能力,人工神经网络(ANN)研究也显示噪声在机器学习任务中有类似益处,但多数工作忽略了相关性的影响。本文探究相关噪声是否能提升人工神经网络对对抗攻击和自然图像变化的鲁棒性。通过比较扰动前后输入的激活值协方差,发现有结构的噪声可显著增强鲁棒性。对自然图像修改的鲁棒性提升最大,但该结构跨修改类型迁移能力弱;相反,对抗攻击产生的噪声结构能较好泛化至其他攻击类型。结果表明,人工网络中激活值的结构化噪声普遍提升鲁棒性,是一种仅依赖局部信息的生物合理策略。

原文摘要 · Abstract (English)

Neural responses in cortex exhibit substantial trial-to-trial variability in response to repeated stimuli, while peripheral sensory neurons respond far more consistently, leading many to wonder whether stochasticity may carry meaning. Existing work has argued that noise and signal correlations may be optimized for discrimination in animals, whereas artificial neural network (ANN) studies have shown similar benefits of noise in machine learning tasks, although most ANN work has neglected the effects of correlations. Here we investigate whether correlated noise improves the robustness of artificial neural networks to adversarial attacks and naturalistic image modifications. Using the covariance of activations under modified versus clean inputs, we find that structured noise may significantly improve network robustness. Robustness to naturalistic image modifications benefits most from structure, but this structure transfers poorly across modification types. In contrast, noise structure from adversarial attacks can generalize to other kinds of attacks. These results suggest that structured noise in ANN activations generally improves robustness, establishing a biologically plausible strategy for creating robust artificial neural networks that only relies on local information.

神经网络鲁棒性噪声建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。