arXiv:2604.03386cs.ROcs.NE2026-04中稿 · GECCO 2026 Compani…

让神经网络在生长后仍能自适应调整,提升控制性能。

Activity-Dependent Plasticity in Morphogenetically-Grown Recurrent Networks

论文配图:Activity-Dependent Plasticity in Morphogenetically-Grown Recurrent Networks
图 1 · 摘自论文原文
  • 通过共进化算法让网络自动生成可塑性规则
  • 抗赫布可塑性使性能提升53%-64%,固定权重损失超50%
  • 适合研究发育式神经网络与自适应控制的学者

神经架构搜索的发育方法通过自组织从紧凑基因组生成功能网络,但其权重在生长后固定不变。我们对5万次形态发生生长的循环控制器(在CartPole和Acrobot上超过500万个配置)进行了赫布与反赫布可塑性的系统分析,随后测试了将可塑性参数编码于基因组并与其共同进化的有效性。结果表明:(1) 对于表现良好的网络,反赫布可塑性显著优于赫布可塑性(Cohen's d = 0.53-0.64);(2) 采用最优固定权重时,遗憾度(即损失的最优改进比例)达52%-100%;(3) 在非平稳环境下,可塑性作用由微调转为真正的适应机制。共进化实验独立发现了这些模式:在CartPole上70%的运行进化出反赫布可塑性(p = 0.043);在Acrobot上进化出接近零的eta值且符号混合——与分析结果完全一致。随机RNN对照显示,反赫布占优是小型循环网络的普遍现象,但拓扑依赖程度具有发育特异性:形态发生网络的遗憾度比匹配拓扑统计量的随机图高出2-6倍。

原文摘要 · Abstract (English)

Developmental approaches to neural architecture search grow functional networks from compact genomes through self-organisation, but the resulting networks operate with fixed post-growth weights. We characterise Hebbian and anti-Hebbian plasticity across 50,000 morphogenetically grown recurrent controllers (5M+ configurations on CartPole and Acrobot), then test whether co-evolutionary experiments -- where plasticity parameters are encoded in the genome and evolved alongside the developmental architecture -- recover these patterns independently. Our characterisation reveals that (1) anti-Hebbian plasticity significantly outperforms Hebbian for competent networks (Cohen's d = 0.53-0.64), (2) regret (fraction of oracle improvement lost under the best fixed setting) reaches 52-100%, and (3) plasticity's role shifts from fine-tuning to genuine adaptation under non-stationarity. Co-evolution independently discovers these patterns: on CartPole, 70% of runs evolve anti-Hebbian plasticity (p = 0.043); on Acrobot, evolution finds near-zero eta with mixed signs -- exactly matching the characterisation. A random-RNN control shows that anti-Hebbian dominance is generic to small recurrent networks, but the degree of topology-dependence is developmental-specific: regret is 2-6x higher for morphogenetically grown networks than for random graphs with matched topology statistics.

神经网络可塑性发育式学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。