arXiv:2505.11142cs.ROcs.CV2025-05被引 1

开源多视角手术遥操作系统,提升手术可视化与协作效率。

Open-Source Multi-Viewpoint Surgical Telerobotics

  • 引入可调节的多视角视觉系统,支持多医生独立观察与操控。
  • 实现同步多视角3D感知,提升术中实时三维建模精度。
  • 完全开源,助力科研与临床转化,适合机器人手术研究者使用。

随着微创手术机器人逐渐趋于模块化和普及,我们相信有机会重新思考并拓展自手术遥操作诞生以来一直沿用的视觉与控制范式。我们认为在腹腔内引入一个或多个可调节视角,不仅能为外科医生提供全新的可视化与协作策略,还能显著增强机器感知对共享自主性的支持能力。即时优势包括:控制第二视角并从不同角度远程操作手术工具,使协作医生可独立调整视野,同时仍能直观操控机器人器械。此外,我们相信同步获取患者解剖结构的多视角3D数据,将解锁更先进的场景表示方法。高精度的术中实时3D感知,将使算法助手能够直接控制一个或多个机器人器械和/或机器人摄像头。为此,我们正在构建一个同步多视角、多传感器的机器人手术系统,集成高性能视觉组件,并升级da Vinci Research Kit的控制逻辑。本文简要报告了系统的功能实现,并阐述其对研究与未来临床实践的潜在影响。通过完全开源,我们期望推动研究社区复现、改进该系统,并开发强大算法,有效加速前沿研究的临床转化。

原文摘要 · Abstract (English)

As robots for minimally invasive surgery (MIS) gradually become more accessible and modular, we believe there is a great opportunity to rethink and expand the visualization and control paradigms that have characterized surgical teleoperation since its inception. We conjecture that introducing one or more additional adjustable viewpoints in the abdominal cavity would not only unlock novel visualization and collaboration strategies for surgeons but also substantially boost the robustness of machine perception toward shared autonomy. Immediate advantages include controlling a second viewpoint and teleoperating surgical tools from a different perspective, which would allow collaborating surgeons to adjust their views independently and still maneuver their robotic instruments intuitively. Furthermore, we believe that capturing synchronized multi-view 3D measurements of the patient's anatomy would unlock advanced scene representations. Accurate real-time intraoperative 3D perception will allow algorithmic assistants to directly control one or more robotic instruments and/or robotic cameras. Toward these goals, we are building a synchronized multi-viewpoint, multi-sensor robotic surgery system by integrating high-performance vision components and upgrading the da Vinci Research Kit control logic. This short paper reports a functional summary of our setup and elaborates on its potential impacts in research and future clinical practice. By fully open-sourcing our system, we will enable the research community to reproduce our setup, improve it, and develop powerful algorithms, effectively boosting clinical translation of cutting-edge research.

手术机器人多视角遥操作开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。