用视网膜突触连接模拟人类视觉的抗干扰能力,提升神经网络鲁棒性。
Retina gap junctions support the robust perception by warping neural representational geometries along the visual hierarchy
- 将视网膜突触连接设计为G-filter,构建生物混合模型
- 该模型决策边界曲率更低,具更强抗干扰能力
- 揭示视网膜连接通过渐进过程重塑神经表征几何
深度神经网络(DNN)虽在诸多任务中表现优异,但对精心设计的对抗噪声极为脆弱。相比之下,人类视觉系统具有高度鲁棒性,但其防御机制尚不明确,尤其早期视觉系统如何影响大脑流形尚不清楚。由于视网膜间隙连接在早期视觉系统的去噪功能中至关重要,本文结合基于视网膜间隙连接的G-filter与DNN,构建一个抽象的人类视觉系统模型——生物混合模型。该模型在对抗攻击下表现出更强鲁棒性,且训练时引入噪声可进一步提升性能。从几何角度分析发现,该模型具有高非线性的2D决策边界,且流形决策边界曲率低于其他防御方法,表明其表征空间的动态变换可能解释其高鲁棒性。为进一步解析G-filter机制,引入神经常微分方程(Neural ODE)思想,将其重写为等效循环神经网络。结果显示,模型流形的决策边界随时间逐渐演化并趋于稳定,该过程受间隙连接电导调控,揭示视网膜间隙连接对大脑流形的影响是渐进式动态过程。
原文摘要 · Abstract (English)
Deep Neural Networks (DNNs) are vulnerable to elaborately designed adversarial noise, although they have achieved extraordinary success in many tasks. Compared with DNNs, the human visual system is highly robust. However, it is unclear how the human visual system defends against adversarial attacks, especially the role of the early visual system and its influence on the brain manifold. Due to retina gap junctions being crucial for the denoising function in the early visual system, we combine a retina gap junction-based filter, G-filter, with DNN as an abstract human visual system model called the biological hybrid model. We adopt this model to study the defense performance of retina gap junctions and their impact on the brain manifold. Compared with other defense methods, the biological hybrid model is more robust and can be further improved by introducing noise during training. Next, we analyze the manifold and its decision boundary of the biological hybrid model from a geometry perspective. The results show that the biological hybrid model has a unique 2D decision boundary with high nonlinearity and a lower curvature of the decision boundary of the manifold compared to other defense methods. The transforming manifold may account for the high robustness of the biological hybrid model. Finally, to dissect G-filter and clarify its internal mechanism, we borrow the Neural Ordinary Differential Equation (ODE) concept and rewrite G-filter into an equivalent recurrent neural network. The results show that the decision boundary of the model's manifold will gradually change with time and eventually reach a steady state, which is modulated by gap junction conductance, revealing the influence of retina gap junctions on the brain manifold is a gradually evolving process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。