arXiv:2501.06762q-bio.NCcs.LG2025-01被引 10

模仿大脑多神经调制机制,提升神经网络持续学习能力。

Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

  • 借鉴多神经调制信号协同作用,设计更灵活的学习规则。
  • 在Go/No-Go任务中显著缓解灾难性遗忘,提升适应性表现。
  • 适合研究持续学习、类脑智能与神经调制机制的学者。

连续自适应学习是自然智能的核心特征。生物体能高效获取、迁移并保留知识,同时应对多变环境,为人工神经网络(ANNs)提供灵感。本文探讨神经调制如何缓解灾难性遗忘,增强ANN在持续学习中的鲁棒性。大脑中多尺度的神经调制过程(如多巴胺DA、乙酰胆碱ACh、5-羟色胺5-HT、去甲肾上腺素NA)通过局部突触可塑性到全局网络适应性的机制响应环境变化。研究表明,神经调制与任务间存在复杂的“多对一”映射关系。本文提出三点启示:(i) 多调制信号交互可超越单一调制学习;(ii) 调制作用跨越时空尺度;(iii) 在ANN中近似并整合神经调制学习机制。通过概念性实验展示,基于多巴胺奖励处理和去甲肾上腺素认知灵活性的机制可显著提升网络在Go/No-Go任务中的性能。本研究旨在弥合生物与人工学习差距,推动更具弹性与适应性的神经网络发展。

原文摘要 · Abstract (English)

Continuous, adaptive learning, the ability to adapt to the environment and keep improving performance, is a hallmark of natural intelligence. Biological organisms excel in acquiring, transferring, and retaining knowledge while adapting to volatile environments, making them a source of inspiration for artificial neural networks (ANNs). This study explores how neuromodulation, a building block of learning in biological systems, can help address catastrophic forgetting and enhance the robustness of ANNs in continual learning. Driven by neuromodulators including dopamine (DA), acetylcholine (ACh), serotonin (5-HT) and noradrenaline (NA), neuromodulatory processes in the brain operate at multiple scales, facilitating dynamic responses to environmental changes through mechanisms ranging from local synaptic plasticity to global network-wide adaptability. Importantly, the relationship between neuromodulators and their interplay in modulating sensory and cognitive processes is more complex than previously expected, demonstrating a "many-to-one" neuromodulator-to-task mapping. To inspire neuromodulation-aware learning rules, we highlight (i) how multi-neuromodulatory interactions enrich single-neuromodulator-driven learning, (ii) the impact of neuromodulators across multiple spatio-temporal scales, and correspondingly, (iii) strategies for approximating and integrating neuromodulated learning processes in ANNs. To illustrate these principles, we present a conceptual study to showcase how neuromodulation-inspired mechanisms, such as DA-driven reward processing and NA-based cognitive flexibility, can enhance ANN performance in a Go/No-Go task. Though multi-scale neuromodulation, we aim to bridge the gap between biological and artificial learning, paving the way for ANNs with greater flexibility, robustness, and adaptability.

持续学习类脑智能神经调制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。