arXiv:2603.03234cs.LG2026-03被引 2

用生物神经机制指导稀疏网络,提升泛化与抗攻击能力。

Guiding Sparse Neural Networks with Neurobiological Principles to Elicit Biologically Plausible Representations

  • 引入稀疏性、权重对数正态分布等生物原则,无需强制约束。
  • 在少样本学习中表现更优,且对抗攻击鲁棒性显著增强。
  • 适合研究生物可解释性模型或神经编码机制的学者。

尽管深度神经网络(DNN)在图像识别等任务中表现优异,但在泛化、少样本学习和持续适应方面仍存在不足,这些能力是生物神经系统的固有特性。问题根源在于DNN未能模拟生物网络高效的自适应学习机制。为此,本文探索将神经生物学假设融入神经网络学习过程。提出一种天然融合稀疏性、对数正态权重分布及戴尔定律(Dale's law)的生物启发学习规则,无需显式强制。该模型在对抗攻击下更具鲁棒性,并在少样本学习场景中表现出更强泛化能力。关键发现是:此类约束促使神经表示自然涌现出生物合理性特征,验证了在神经网络设计中引入神经生物学假设的有效性。初步结果表明,该方法可能从特异性特征编码扩展至任务特异性编码,为复杂任务中的神经资源分配提供新见解。

原文摘要 · Abstract (English)

While deep neural networks (DNNs) have achieved remarkable performance in tasks such as image recognition, they often struggle with generalization, learning from few examples, and continuous adaptation - abilities inherent in biological neural systems. These challenges arise due to DNNs' failure to emulate the efficient, adaptive learning mechanisms of biological networks. To address these issues, we explore the integration of neurobiologically inspired assumptions in neural network learning. This study introduces a biologically inspired learning rule that naturally integrates neurobiological principles, including sparsity, lognormal weight distributions, and adherence to Dale's law, without requiring explicit enforcement. By aligning with these core neurobiological principles, our model enhances robustness against adversarial attacks and demonstrates superior generalization, particularly in few-shot learning scenarios. Notably, integrating these constraints leads to the emergence of biologically plausible neural representations, underscoring the efficacy of incorporating neurobiological assumptions into neural network design. Preliminary results suggest that this approach could extend from feature-specific to task-specific encoding, potentially offering insights into neural resource allocation for complex tasks.

稀疏网络生物启发少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。