arXiv:2508.07115q-bio.NCcs.CV2025-08被引 1

反馈+随机性让视觉模型更抗干扰,像人脑一样稳定鲁棒。

Sensory robustness through top-down feedback and neural stochasticity in recurrent vision models

  • 用反馈连接和神经随机化训练递归模型
  • 噪声和对抗攻击下准确率提升,速度也更快
  • 适合研究脑启发视觉系统或鲁棒模型的学者

生物视觉系统依赖自上而下的反馈,但多数人工视觉模型仅靠前馈或递归结构即可完成图像分类,这引发了对下行皮层通路功能意义的质疑。本文在有无自上而下反馈的条件下训练卷积递归神经网络(ConvRNN),探究其计算贡献。结果发现,只有在引入随机神经变异(通过丢弃单个神经元模拟)的情况下,含反馈的ConvRNN才表现出显著的速度-精度权衡优势及对噪声扰动和对抗攻击的鲁棒性。详细分析表明,反馈信息显著塑造了整合后层的表征几何结构,融合上下文流,并被丢弃增强;同时反馈与丢弃协同将网络活动约束在低维流形上,在分布外场景中更高效编码对象信息,且自上而下信号在群体层面稳定了表征动态。这些发现揭示了感官编码鲁棒性的双重机制:一方面,神经随机性防止单元级共适应,尽管带来更混乱的动态;另一方面,自上而下反馈利用高层信息将网络活动稳定在紧凑的低维流形上。

原文摘要 · Abstract (English)

Biological systems leverage top-down feedback for visual processing, yet most artificial vision models succeed in image classification using purely feedforward or recurrent architectures, calling into question the functional significance of descending cortical pathways. Here, we trained convolutional recurrent neural networks (ConvRNN) on image classification in the presence or absence of top-down feedback projections to elucidate the specific computational contributions of those feedback pathways. We found that ConvRNNs with top-down feedback exhibited remarkable speed-accuracy trade-off and robustness to noise perturbations and adversarial attacks, but only when they were trained with stochastic neural variability, simulated by randomly silencing single units via dropout. By performing detailed analyses to identify the reasons for such benefits, we observed that feedback information substantially shaped the representational geometry of the post-integration layer, combining the bottom-up and top-down streams, and this effect was amplified by dropout. Moreover, feedback signals coupled with dropout optimally constrained network activity onto a low-dimensional manifold and encoded object information more efficiently in out-of-distribution regimes, with top-down information stabilizing the representational dynamics at the population level. Together, these findings uncover a dual mechanism for resilient sensory coding. On the one hand, neural stochasticity prevents unit-level co-adaptation albeit at the cost of more chaotic dynamics. On the other hand, top-down feedback harnesses high-level information to stabilize network activity on compact low-dimensional manifolds.

视觉模型反馈机制鲁棒性随机性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。