arXiv:2511.03882cs.CVcs.AI2025-11被引 1

用视觉模仿学习控制机器人完成脊柱穿刺,成功率超六成。

Investigating Robot Control Policy Learning for Autonomous X-ray-guided Spine Procedures

  • 基于双平面X光视觉信息,通过模仿学习训练机器人规划与开环控制策略。
  • 首次尝试成功率达68.5%,能保持不同椎体水平的安全穿刺路径。
  • 可在复杂解剖结构和真实X光上实现部分仿真到现实的迁移。

基于模仿学习的机器人控制策略在视频驱动机器人中重获关注,但其在稀疏输入条件下的X射线引导手术(如脊柱置管)中的适用性尚不明确。本文研究了双平面引导下导管插入的模仿学习可行性、机遇与挑战。构建了一个高保真的虚拟仿真环境,用于大规模自动化模拟脊柱手术;采集了正确轨迹与对应双平面X光序列数据,模拟医生逐步对齐操作。在此基础上,训练了仅依赖视觉信息的规划与开环控制策略,实现椎体成形术中导管的逐次对齐。该受控实验揭示了该方法的局限与能力:首次尝试成功率68.5%,可在不同椎体水平维持安全的椎弓根内路径;策略可迁移至骨折及变异解剖结构,以及不同初始位置。真实X光上的推演表明,具备合理路径的仿真到现实部分迁移是可行的。尽管初步结果令人鼓舞,仍存在入口点精度不足等局限。当前成果为未来工作提供了明确基准,结合更强先验与领域知识,此类模型或可成为轻量化、无需CT的术中脊柱导航基础。

原文摘要 · Abstract (English)

Imitation learning-based robot control policies are enjoying renewed interest in video-based robotics. However, it remains unclear whether this approach applies to X-ray-guided procedures, such as spine instrumentation, with sparse inputs. We examine the feasibility, opportunities and challenges for imitation policy learning in bi-plane-guided cannula insertion. We develop an in silico sandbox for scalable, automated simulation of X-ray-guided spine procedures with a high degree of realism. We curate a dataset of correct trajectories and corresponding bi-planar X-ray sequences that emulate the stepwise alignment of providers. We then train imitation learning policies for planning and open-loop control that iteratively align a cannula in a vertebroplasty setting solely based on visual information. This precisely controlled setup offers insights into limitations and capabilities of this method. Our policy succeeded on the first attempt in 68.5% of cases, maintaining safe intra-pedicular trajectories across diverse vertebral levels. The policy transferred to complex anatomy, including fractures, as well as varied anatomies and initializations. Rollouts on real X-ray indicate that partial sim-to-real transfer with plausible trajectories is possible. While these preliminary results are promising, we also identify limitations, especially in entry point precision. The current results present a clear benchmark for future efforts, while with more robust priors and domain knowledge, such models may provide a foundation for future efforts toward lightweight and CT-free robotic intra-operative spinal navigation.

机器人手术模仿学习X光导航脊柱穿刺

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。