用进化模拟揭示捕食压力如何塑造恐惧与群体社交奖励的演化
Evolution of Fear and Social Rewards in Prey-Predator Relationship
- 通过共演化强化学习代理,模拟猎物与捕食者间的奖励机制
- 捕食者越强,猎物恐惧感越强;食物越少,群体正向奖励越显著
- 主动狩猎的捕食者是恐惧演化的关键驱动力,静态陷阱不引发恐惧
恐惧是大脑的关键功能,使我们通过强化学习规避危险。尽管普遍认为恐惧是为了逃避捕食者而演化,但不同捕食压力如何影响恐惧及其他奖励(如群体聚集带来的正向社交奖励)仍不清楚。本研究通过强化学习代理的进化模拟,探究了捕食压力与恐惧的关系。在模拟中,猎物与捕食者的奖励函数共同演化,包括观察对方的视觉奖励。结果发现,猎物常演化出对捕食者的负向视觉奖励(类似恐惧),但也出现对捕食者和猎物均产生正向奖励的情况,后者可作为群体聚集的社交奖励。不同环境对比显示:捕食者狩猎能力越强,恐惧奖励越强;食物越稀缺,负向社会奖励越明显。此外,面对无害的静态陷阱,恐惧未演化,说明主动狩猎的捕食者在恐惧演化中起关键作用。研究揭示了捕食者在恐惧与社会奖励多样化演化中的核心角色。
原文摘要 · Abstract (English)
Fear is a critical brain function that enables us to learn to avoid danger via reinforcement learning (RL). While many researchers have argued that fear has evolved to escape predators, how varying predatory pressures have shaped fear and other rewards, including positive social rewards for collective grouping, remains an open question. In this study, we investigate the relationship between predatory pressure and fear using an evolutionary simulation of RL agents with evolving rewards. In our simulation, prey and predator RL agents co-evolve their reward functions, including visual rewards for observing prey and predators. While fear-like negative visual rewards for predators often evolved in prey, we also observed cases in which positive rewards for both predators and prey evolved, the latter serving as a social reward for collective grouping. A comparison between different environmental conditions revealed that stronger predator hunting capability promoted stronger fear reward, while less food supply promoted more negative social reward. Moreover, fear did not evolve in response to static pitfalls with non-lethal damage, suggesting that actively hunting predators played an important role in its evolution. These results highlight the special role of predators in the diverse evolution of fear and social rewards.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。