arXiv:2507.13485cs.NEcs.AI2025-07

让神经网络不同层用不同生物启发学习规则,提升精度与可扩展性。

Neural Architecture Search with Mixed Bio-inspired Learning Rules

  • 通过自定义神经架构搜索,自动为各层选择最优生物启发学习规则。
  • 混合规则模型在CIFAR-10等数据集上达95.16%准确率,创生物启发模型新纪录。
  • 兼具高鲁棒性与接近或超越传统反向传播模型的性能,适合研究类脑计算者。

生物启发神经网络因其对抗鲁棒性、低功耗及更贴近皮层生理特性而备受关注,但其准确率和可扩展性常落后于基于反向传播(BP)的模型。本文表明,通过在不同层中自动采用不同的生物启发学习规则,并利用定制化的神经架构搜索(NAS)方法实现,可有效弥合这一差距。从标准NAS基线出发,将搜索空间扩展至包含多种生物启发学习规则,以寻找每层最优架构与学习规则组合。结果表明,分层使用不同生物启发学习规则的网络,在准确性上显著优于全网统一规则的模型。所提出的混合规则网络在多个基准上创下生物启发模型新纪录:在CIFAR-10上达到95.16%,CIFAR-100上76.48%,ImageNet16-120上43.42%,以及ImageNet上60.51%的Top-1准确率。在某些场景下,其性能甚至超越同类BP模型,同时保持原有鲁棒性优势。研究结果表明,学习规则的层间多样性有助于提升网络的可扩展性与准确性,推动多规则混合在神经网络中的进一步探索。

原文摘要 · Abstract (English)

Bio-inspired neural networks are attractive for their adversarial robustness, energy frugality, and closer alignment with cortical physiology, yet they often lag behind back-propagation (BP) based models in accuracy and ability to scale. We show that allowing the use of different bio-inspired learning rules in different layers, discovered automatically by a tailored neural-architecture-search (NAS) procedure, bridges this gap. Starting from standard NAS baselines, we enlarge the search space to include bio-inspired learning rules and use NAS to find the best architecture and learning rule to use in each layer. We show that neural networks that use different bio-inspired learning rules for different layers have better accuracy than those that use a single rule across all the layers. The resulting NN that uses a mix of bio-inspired learning rules sets new records for bio-inspired models: 95.16% on CIFAR-10, 76.48% on CIFAR-100, 43.42% on ImageNet16-120, and 60.51% top-1 on ImageNet. In some regimes, they even surpass comparable BP-based networks while retaining their robustness advantages. Our results suggest that layer-wise diversity in learning rules allows better scalability and accuracy, and motivates further research on mixing multiple bio-inspired learning rules in the same network.

神经架构搜索生物启发学习规则模型性能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。