用AI虚拟鱼引导真实鱼群,实现实时闭环控制。
A Deep Reinforcement Learning Framework for Closed-loop Guidance of Fish Schools via Virtual Agents
- 通过深度强化学习训练虚拟代理,实时控制鱼群方向。
- 白色背景+大刺激物时引导效果最佳,群体越大越难控制。
- 单个智能体已足够,多代理无提升,适合生物行为研究。
引导生物群体的集体运动是理解社会互动机制的核心挑战。本文提出一种基于深度强化学习(RL)的闭环鱼群引导框架,利用虚拟代理在仿真中通过近端策略优化(PPO)训练,并部署于实际实验中的红鼻铅笔鱼(Petitella bleheri)。为应对活体个体的随机行为,设计了兼顾方向引导与群体凝聚力的复合奖励函数,实现控制目标层面的功能仿生。系统评估显示,在物理实验中白色背景与较大刺激尺寸的组合引导效果最优。跨群体规模与代理配置的测试表明,当群体从5增至8只时引导效率下降,且多个独立控制的代理未能提升效果。物理实验中分析发现,学习到的策略使代理向目标移动的同时保持靠近鱼群,若前进过远则会重新靠近。本研究展示了深度强化学习在鱼群闭环引导中的潜力,并揭示了在大型群体中维持人工干预的挑战。
原文摘要 · Abstract (English)
Guiding collective motion in biological groups is a fundamental challenge in understanding social interaction rules. In this study, we propose a deep reinforcement learning (RL) framework for closed-loop guidance of fish schools using virtual agents. These agents are controlled by policies trained via Proximal Policy Optimization (PPO) in simulation and deployed in physical experiments with rummy-nose tetras (Petitella bleheri), enabling real-time interaction between artificial agents and live individuals. To cope with the stochastic behavior of live individuals, we designed a composite reward function that balances directional guidance with cohesion, providing a form of functional biomimicry at the level of the control objective. Our systematic evaluation of visual parameters showed that a white background and larger stimulus sizes produced the highest guidance efficacy among the tested conditions in physical trials. Furthermore, evaluation across group sizes and agent configurations indicated that guidance efficacy decreased as the group size increased from five to eight individuals, and that using multiple independently controlled agents did not improve guidance. Analysis of agent motion in the physical trials indicated that, under the learned policy, the agent moved toward the target while remaining close to the school and re-approached the school after advancing too far ahead. This study highlights the potential of deep RL for closed-loop guidance of fish schools and identifies challenges in maintaining artificial influence in larger groups.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。