arXiv:2507.01152cs.RO2025-07NeurIPS被引 8

构建高仿真机器人超声模拟平台,支持复杂手术任务的高效训练。

SonoGym: High Performance Simulation for Challenging Surgical Tasks with Robotic Ultrasound

  • 基于物理与生成模型融合,实现实时逼真的超声数据模拟。
  • 在数十至数百个并行环境中成功训练深度强化学习与模仿学习策略。
  • 适用于骨科手术导航与解剖重建,适合机器人学习研究者使用。

超声成像是因其实时性、无创性和低成本而广泛应用的医学影像技术。机器人超声可进一步降低对操作者的依赖,并提升对复杂解剖区域的可达性。然而,尽管深度强化学习(DRL)和模仿学习(IL)在自主导航中展现出潜力,其在解剖结构重建和术中引导等复杂手术任务中的应用仍受限,主要因缺乏针对此类任务设计的真实且高效的仿真环境。本文提出 SonoGym,一个可扩展的仿真平台,支持数十到数百个并行环境下的复杂机器人超声任务仿真。该框架通过基于物理和生成建模的方法,从CT构建的三维解剖模型中实时生成逼真的超声数据。SonoGym 集成常见机器人平台与骨科末端执行器,支持视觉变换器与扩散策略等最新模仿学习方法及子模态强化学习(submodular DRL)、安全强化学习在骨科机器人手术中的应用。实验结果表明,所提方法在多种场景下均实现有效策略学习,同时揭示了当前方法在临床相关环境中的局限性。数据集、代码与视频已公开于 https://sonogym.github.io/。

原文摘要 · Abstract (English)

Ultrasound (US) is a widely used medical imaging modality due to its real-time capabilities, non-invasive nature, and cost-effectiveness. Robotic ultrasound can further enhance its utility by reducing operator dependence and improving access to complex anatomical regions. For this, while deep reinforcement learning (DRL) and imitation learning (IL) have shown potential for autonomous navigation, their use in complex surgical tasks such as anatomy reconstruction and surgical guidance remains limited -- largely due to the lack of realistic and efficient simulation environments tailored to these tasks. We introduce SonoGym, a scalable simulation platform for complex robotic ultrasound tasks that enables parallel simulation across tens to hundreds of environments. Our framework supports realistic and real-time simulation of US data from CT-derived 3D models of the anatomy through both a physics-based and a generative modeling approach. Sonogym enables the training of DRL and recent IL agents (vision transformers and diffusion policies) for relevant tasks in robotic orthopedic surgery by integrating common robotic platforms and orthopedic end effectors. We further incorporate submodular DRL -- a recent method that handles history-dependent rewards -- for anatomy reconstruction and safe reinforcement learning for surgery. Our results demonstrate successful policy learning across a range of scenarios, while also highlighting the limitations of current methods in clinically relevant environments. We believe our simulation can facilitate research in robot learning approaches for such challenging robotic surgery applications. Dataset, codes, and videos are publicly available at https://sonogym.github.io/.

机器人手术超声仿真强化学习骨科手术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。