让蜂群控制器在持续学习中不遗忘旧任务,提升群体适应力。
Lifelong Evolution of Swarms
- 用动态任务演化蜂群控制器群体,实现持续学习
- 群体自然保留历史任务知识,个体则会灾难性遗忘
- 引入正则化减少顶尖个体遗忘,适合研究群体智能的学者
在不遗忘先前知识的前提下适应任务变化,是智能系统实现持续学习的关键。然而,传统蜂群控制器通常针对特定任务设计,缺乏跨任务的知识保留能力。现有持续学习研究多聚焦单个智能体,对群体涌现行为关注不足。为此,我们提出一种面向蜂群的持续演化框架:在逐步引入新任务的动态环境中,演化一组蜂群控制器。该过程要求控制器快速适应新任务并保留过往知识(因任务可能重现)。实验发现,群体能自然保存历史任务信息,并可重用以加速适应、缓解遗忘;而单一最优个体在面对新任务时会完全遗忘旧知识。为解决此问题,我们设计了针对进化算法的正则化机制,显著降低顶级个体的遗忘程度。该方法揭示了当前深度持续学习的局限性,并挑战了蜂群控制器在动态环境中的鲁棒性认知。
原文摘要 · Abstract (English)
Adapting to task changes without forgetting previous knowledge is a key skill for intelligent systems, and a crucial aspect of lifelong learning. Swarm controllers, however, are typically designed for specific tasks, lacking the ability to retain knowledge across changing tasks. Lifelong learning, on the other hand, focuses on individual agents with limited insights into the emergent abilities of a collective like a swarm. To address this gap, we introduce a lifelong evolutionary framework for swarms, where a population of swarm controllers is evolved in a dynamic environment that incrementally presents novel tasks. This requires evolution to find controllers that quickly adapt to new tasks while retaining knowledge of previous ones, as they may reappear in the future. We discover that the population inherently preserves information about previous tasks, and it can reuse it to foster adaptation and mitigate forgetting. In contrast, the top-performing individual for a given task catastrophically forgets previous tasks. To mitigate this phenomenon, we design a regularization process for the evolutionary algorithm, reducing forgetting in top-performing individuals. Evolving swarms in a lifelong fashion raises fundamental questions on the current state of deep lifelong learning and on the robustness of swarm controllers in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。