arXiv:2410.11703cs.ROcs.CV2024-10被引 5

开发机器人臂平台实现微创手术三维重建,精度达亚毫米级。

Robotic Arm Platform for Multi-View Image Acquisition and 3D Reconstruction in Minimally Invasive Surgery

  • 用机械臂控制腹腔镜拍摄多视角图像,实现可控数据采集。
  • 在理想光照与轨迹下,平均误差仅1.05毫米,接近亚毫米级精度。
  • 适合训练手术视觉模型的研究者,可生成高质量三维数据集。

微创手术(MIS)虽能减少恢复时间和患者创伤,但视野和操作受限,精准三维重建对术前规划和导航至关重要。本文提出一种用于MIS环境的机器人臂平台,通过将腹腔镜安装于机械臂,采集多种绵羊器官在不同光照条件(手术室与腹腔镜照明)及运动轨迹(球形与腹腔镜路径)下的体外图像。结合最新的基于学习的特征匹配方法与COLMAP进行三维重建,并以高精度激光扫描为基准进行定量评估。结果表明,在真实MIS光照与轨迹条件下重建性能下降,但在理想条件下(手术室光照+球形轨迹)多数方案达到近亚毫米级精度:均方根误差平均为1.05毫米,切比雪夫距离为0.82毫米。该平台可实现受控、可重复的多视角图像采集,有望推动面向MIS场景的深度学习模型训练数据集建设。

原文摘要 · Abstract (English)

Minimally invasive surgery (MIS) offers significant benefits such as reduced recovery time and minimised patient trauma, but poses challenges in visibility and access, making accurate 3D reconstruction a significant tool in surgical planning and navigation. This work introduces a robotic arm platform for efficient multi-view image acquisition and precise 3D reconstruction in MIS settings. We adapted a laparoscope to a robotic arm and captured ex-vivo images of several ovine organs across varying lighting conditions (operating room and laparoscopic) and trajectories (spherical and laparoscopic). We employed recently released learning-based feature matchers combined with COLMAP to produce our reconstructions. The reconstructions were evaluated against high-precision laser scans for quantitative evaluation. Our results show that whilst reconstructions suffer most under realistic MIS lighting and trajectory, many versions of our pipeline achieve close to sub-millimetre accuracy with an average of 1.05 mm Root Mean Squared Error and 0.82 mm Chamfer distance. Our best reconstruction results occur with operating room lighting and spherical trajectories. Our robotic platform provides a tool for controlled, repeatable multi-view data acquisition for 3D generation in MIS environments which we hope leads to new datasets for training learning-based models.

三维重建微创手术机器人臂医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。