通过空间正则化提升神经网络鲁棒性并重塑表征结构
Beyond topography: Topographic regularization improves robustness and reshapes representations in convolutional neural networks
- 引入两种局部空间损失:权重相似与激活相似,约束神经元邻近关系
- 在CIFAR-10和MNIST上均提升抗扰动能力,且增强单元功能定位
- 揭示拓扑正则化可系统改变表征组织方式,适合脑启发模型研究者
拓扑卷积神经网络(TCNN)模拟大脑空间与功能组织。本文比较了两种局部空间损失在末层拓扑网格上的效果:一是权重相似性(WS),惩罚邻近单元输入权重向量差异;二是激活相似性(AS),惩罚邻近单元对刺激的激活模式差异。结果表明,两者均改变单元间相关结构,但机制不同:WS产生平滑拓扑,邻近单元高度相关;而AS导致双峰相关结构,缺乏空间连续性。相较于非拓扑对照组,两种方法均提升鲁棒性——AS在CIFAR-10上增强抗图像退化能力,WS在MNIST上表现更优,并且二者均提高对权重扰动的鲁棒性。此外,WS还带来更高输入敏感性和更强的功能局部化。相比对照组,两者还改变了单元的方向选择性、对称敏感度及离心率分布。结果表明,局部拓扑正则化可在端到端训练中提升鲁棒性,同时系统重塑表征结构。
原文摘要 · Abstract (English)
Topographic convolutional neural networks (TCNNs) are computational models that can simulate aspects of the brain's spatial and functional organization. However, it is unclear whether and how different types of topographic regularization shape robustness, representational structure, and functional organization during end-to-end training. We address this question by comparing TCNNs trained with two local spatial losses applied to a penultimate-layer topographic grid: i) Weight Similarity (WS), whose objective penalizes differences between neighboring units' incoming weight vectors, and ii) Activation Similarity (AS), whose objective penalizes differences between neighboring units' activation patterns over stimuli. We evaluate the trained models on classification accuracy, robustness to weight perturbations and input degradation, the spatial organization of learned representations, and development of category-selective "expert units" in the penultimate layer. Both losses changed inter-unit correlation structure, but in qualitatively different ways. WS produced smooth topographies, with correlated neighborhoods. In contrast, AS produced a bimodal inter-unit correlation structure that lacked spatial smoothness. AS and WS training increased robustness relative to control (non-topographic) models: AS improved robustness to image degradation on CIFAR-10, WS did so on MNIST, and both improved robustness to weight perturbations. WS was also associated with greater input sensitivity at the unit level and stronger functional localization. In addition, as compared to control models, both AS and WS produced differences in orientation tuning, symmetry sensitivity, and eccentricity profiles of units. Together, these results show that local topographic regularization can improve robustness during end-to-end training while systematically reshaping representational structure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。