arXiv:2607.24860cs.RO2026-07

用强化学习让机器鱼在未知湍流中稳住位置,不靠外部感知。

Egocentric Station Holding of Robotic Fish in Unknown Turbulent Background Flow

论文配图:Egocentric Station Holding of Robotic Fish in Unknown Turbulent Background Flow
图 1 · 摘自论文原文
  • 结合实验与仿真,通过强化学习训练机器鱼自主保持位置。
  • 相比现有方法,定位误差(RMSE)显著降低,性能全面提升。
  • 仅依赖自身运动反馈即可稳住位置,类比生物趋流行为,适合水下机器人研究者。

在自然水域中接近目标位置并保持稳定位置,是机器人鱼在复杂环境中运行的基础能力。尽管多年来游泳效率和机动性持续提升,但该能力仍发展不足,主要因自由游动的机器人鱼在流动中存在难以量化的非线性流固耦合效应。为此,我们提出SWiFT框架——一种游泳伴随流场的工具箱,利用强化学习高效探索体尾鳍(BCF)型机器人鱼在未知湍流背景流中的自参考站位策略。SWiFT融合自由游动流槽实验、高效率物理一致的基于计算流体动力学(CFD)的模拟器及系统的仿真到现实迁移流程。所获策略在所有指标上均优于当前最优方法,尤其在距离均方根误差(RMSE)方面表现突出。此外,验证表明仅依靠自参考反馈(无需显式流场感知)即可实现未知湍流中的站位,与生物趋流现象高度相似。该策略的成功不仅推动了机器人鱼控制向真实部署迈进,也凸显了SWiFT在解决复杂水下机器人游泳任务中的潜力。

原文摘要 · Abstract (English)

Approaching a target position and holding station in flowing water is a fundamental and critical capability for robotic fish operating in natural aquatic environments. Despite decades of advances in enhancing swimming efficiency and maneuverability, this capability remains underdeveloped, largely owing to the insufficiently characterized, highly nonlinear fluid-structure interactions inherent to freely swimming robotic fish in flows. To bridge this gap, we propose the SWiFT framework, a Swimming With Flow Toolbox that enables the efficient exploration of an egocentric station-holding policy for a body and/or caudal fin (BCF) robotic fish in unknown and turbulent background flows via reinforcement learning (RL). Our SWiFT integrates a free-swimming flow-tank experimental setup with a highly efficient, physically consistent computational fluid dynamics (CFD)-based simulator and a systematic sim-to-real transfer pipeline. The resulting policy achieves substantial improvements over state-of-the-art methods across all metrics, most notably root-mean-square error (RMSE) of distance. Furthermore, we validated that egocentric feedback alone, without any explicit flow sensing, enables station-holding in unknown turbulent flows, closely mirroring the biological phenomenon of rheotaxis. Accordingly, the success of this egocentric station-holding policy not only advances robotic fish control toward real-world deployment, but also highlights SWiFT's promise as a foundation for tackling complex swimming tasks for underwater robots.

机器人鱼强化学习流体控制仿生导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。