用在线专家纠错提升机器人导管在血管分叉处的自主导航效率。
Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation
- 结合实时状态估计与模糊控制,动态调整导管方向。
- 仅需123次训练就收敛,比基线快25.9%,位置误差降为83.8%。
- 适合需要高精度、低样本消耗的血管介入手术机器人研究者。
机器人辅助血管内介入手术可安全高效地实现远程导管操控,降低辐射暴露并提升导航精度。强化学习(RL)近年来成为自主导管导航的有前景方法,但传统方法面临奖励稀疏和依赖静态血管模型的问题,导致样本效率低且难以适应术中变化。为此,本文提出一种具在线专家纠错能力的样本高效强化学习框架,用于血管分叉处的自主导管导航。该框架包含三部分:(1)基于分割的姿态估计模块,实现精准实时状态反馈;(2)面向分叉结构的模糊控制器,用于方向自适应调整;(3)融合专家先验的结构化奖励生成器,引导策略学习。通过在线专家纠错机制,显著减少探索低效性,并增强复杂血管结构下的策略鲁棒性。在透明血管仿体上基于机器人平台的实验表明,该方法仅需123次训练即实现收敛,相较基线软演员-评论家(SAC)算法减少25.9%;平均位置误差降至基线的83.8%。结果表明,结合样本高效强化学习与在线专家纠错,可在关键的血管分叉场景下实现可靠、精确的导管导航。
原文摘要 · Abstract (English)
Robot-assisted endovascular intervention offers a safe and effective solution for remote catheter manipulation, reducing radiation exposure while enabling precise navigation. Reinforcement learning (RL) has recently emerged as a promising approach for autonomous catheter steering; however, conventional methods suffer from sparse reward design and reliance on static vascular models, limiting their sample efficiency and generalization to intraoperative variations. To overcome these challenges, this paper introduces a sample-efficient RL framework with online expert correction for autonomous catheter steering in endovascular bifurcation navigation. The proposed framework integrates three key components: (1) A segmentation-based pose estimation module for accurate real-time state feedback, (2) A fuzzy controller for bifurcation-aware orientation adjustment, and (3) A structured reward generator incorporating expert priors to guide policy learning. By leveraging online expert correction, the framework reduces exploration inefficiency and enhances policy robustness in complex vascular structures. Experimental validation on a robotic platform using a transparent vascular phantom demonstrates that the proposed approach achieves convergence in 123 training episodes -- a 25.9% reduction compared to the baseline Soft Actor-Critic (SAC) algorithm -- while reducing average positional error to 83.8% of the baseline. These results indicate that combining sample-efficient RL with online expert correction enables reliable and accurate catheter steering, particularly in anatomically challenging bifurcation scenarios critical for endovascular navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。