用仿真环境训练机器人自主导航,成功实现在真实场景中的迁移。
Learning-Based Autonomous Navigation, Benchmark Environments and Simulation Framework for Endovascular Interventions
- 基于深度强化学习,在三类数字基准中实现自主导管导航。
- 基础与复杂路径导航成功率高,双器械操作中等,可从仿真迁移到物理平台。
- 开源框架与基准降低研究门槛,促进领域对比与进展。
血管内介入手术是挽救生命的重要治疗手段,但存在辐射暴露和熟练医师短缺等问题。机器人辅助可能缓解这些挑战。当前基于人工智能的自主血管内介入研究日益增多,但评估环境差异导致方法难以比较,因各研究使用不同评价框架。本研究提出基于深度强化学习的自主导管导航方法,在三个数字基准任务(BasicWireNav、ArchVariety、DualDeviceNav)上实现训练。所有任务均在模块化仿真框架stEVE(simulated EndoVascular Environment)中实现。控制器仅在仿真中训练,后在仿真和带摄像头与透视反馈的物理测试台进行评估。BasicWireNav和ArchVariety任务达到高成功率,并成功从仿真迁移至物理平台;DualDeviceNav任务达到中等成功率。实验验证了stEVE的可行性及其将仿真训练控制器迁移到现实场景的潜力。研究同时揭示了未来改进空间。通过开源训练脚本、基准数据集与stEVE框架,本工作降低了研究门槛,提升了该领域方法的可比性与可复现性。
原文摘要 · Abstract (English)
Endovascular interventions are a life-saving treatment for many diseases, yet suffer from drawbacks such as radiation exposure and potential scarcity of proficient physicians. Robotic assistance during these interventions could be a promising support towards these problems. Research focusing on autonomous endovascular interventions utilizing artificial intelligence-based methodologies is gaining popularity. However, variability in assessment environments hinders the ability to compare and contrast the efficacy of different approaches, primarily due to each study employing a unique evaluation framework. In this study, we present deep reinforcement learning-based autonomous endovascular device navigation on three distinct digital benchmark interventions: BasicWireNav, ArchVariety, and DualDeviceNav. The benchmark interventions were implemented with our modular simulation framework stEVE (simulated EndoVascular Environment). Autonomous controllers were trained solely in simulation and evaluated in simulation and on physical test benches with camera and fluoroscopy feedback. Autonomous control for BasicWireNav and ArchVariety reached high success rates and was successfully transferred from the simulated training environment to the physical test benches, while autonomous control for DualDeviceNav reached a moderate success rate. The experiments demonstrate the feasibility of stEVE and its potential for transferring controllers trained in simulation to real-world scenarios. Nevertheless, they also reveal areas that offer opportunities for future research. This study demonstrates the transferability of autonomous controllers from simulation to the real world in endovascular navigation and lowers the entry barriers and increases the comparability of research on endovascular assistance systems by providing open-source training scripts, benchmarks and the stEVE framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。