arXiv:2601.15545cs.RO2026-01

用深度强化学习让磁控机器人在胃肠道内精准导航,15分钟完成部署。

A Mobile Magnetic Manipulation Platform for Gastrointestinal Navigation with Deep Reinforcement Learning Control

  • 基于SAC算法的DRL控制,无需复杂物理建模。
  • 2D路径误差仅1.18~1.50毫米,30cm×20cm工作区成功覆盖。
  • 适合临床前测试与快速原型开发,部署快、成本低。

利用磁控机器人进行胃肠道靶向给药是系统性治疗的有前景替代方案。然而,控制这些机器人仍面临挑战:固定磁系统工作空间有限,而移动系统(如机械臂上的线圈)存在“模型校准瓶颈”,需耗时复杂的预校准物理模型且计算成本高。本文提出一种紧凑、低成本的移动磁操控平台,采用基于深度强化学习(DRL)的方法克服该限制。系统配备安装在UR5协作机器人上的四电磁体阵列,通过仿真到现实的训练流程,使用软演员-评论家(SAC)策略,在15分钟内实现有效策略部署。我们验证了对7毫米磁胶囊在二维轨迹上的控制性能:方形路径均方根误差(RMSE)为1.18~mm,圆形路径为1.50~mm。同时,成功实现了在30 cm × 20 cm临床相关工作区内的稳定跟踪。本研究展示了一种可快速部署的无模型控制框架,可在大工作区实现精确磁操控,并在二维胃肠道仿真实验中得到验证。

原文摘要 · Abstract (English)

Targeted drug delivery in the gastrointestinal (GI) tract using magnetic robots offers a promising alternative to systemic treatments. However, controlling these robots is a major challenge. Stationary magnetic systems have a limited workspace, while mobile systems (e.g., coils on a robotic arm) suffer from a "model-calibration bottleneck", requiring complex, pre-calibrated physical models that are time-consuming to create and computationally expensive. This paper presents a compact, low-cost mobile magnetic manipulation platform that overcomes this limitation using Deep Reinforcement Learning (DRL). Our system features a compact four-electromagnet array mounted on a UR5 collaborative robot. A Soft Actor-Critic (SAC)-based control strategy is trained through a sim-to-real pipeline, enabling effective policy deployment within 15 minutes and significantly reducing setup time. We validated the platform by controlling a 7-mm magnetic capsule along 2D trajectories. Our DRL-based controller achieved a root-mean-square error (RMSE) of 1.18~mm for a square path and 1.50~mm for a circular path. We also demonstrated successful tracking over a clinically relevant, 30 cm * 20 cm workspace. This work demonstrates a rapidly deployable, model-free control framework capable of precise magnetic manipulation in a large workspace,validated using a 2D GI phantom.

磁控机器人强化学习精准医疗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。