arXiv:2411.18884cs.ROcs.CV2024-11ICRA被引 4

用AI预测内镜下黏膜剥离手术路径和安全边界,提升手术精度与安全性。

ETSM: Automating Dissection Trajectory Suggestion and Confidence Map-Based Safety Margin Prediction for Robot-assisted Endoscopic Submucosal Dissection

  • 基于回归网络预测手术区域信心图,划分不同安全等级
  • 在自建1849段视频数据集上实现3.18毫米平均误差
  • 适合做智能外科机器人辅助系统研发或临床训练

机器人辅助内镜黏膜下剥离术(ESD)通过先进机械臂与双臂操作,提升了术中视野与操作精度。准确预测剥离路径对减少术中失误、优化决策及培训具有重要意义,但受肿瘤边界多变与视觉动态影响,挑战较大。为此,我们构建了包含1849个短片段的ETSM数据集,聚焦双臂机器人系统的黏膜下剥离。提出结合最优路径预测与信心图驱动的安全边界生成框架,并设计回归式信心图预测网络(RCMNet),以可视化方式刻画不同安全等级的剥离范围。在域内、鲁棒性及域外三种评估设置下,该方法在信心图驱动的安全边界预测任务中表现优异,平均绝对误差(MAE)仅3.18毫米。据我们所知,这是首个将回归方法应用于可视化划分剥离区域安全层级的研究。本工作填补了现有研究空白,显著提升了预测准确性与手术安全性,具备重要临床价值。

原文摘要 · Abstract (English)

Robot-assisted Endoscopic Submucosal Dissection (ESD) improves the surgical procedure by providing a more comprehensive view through advanced robotic instruments and bimanual operation, thereby enhancing dissection efficiency and accuracy. Accurate prediction of dissection trajectories is crucial for better decision-making, reducing intraoperative errors, and improving surgical training. Nevertheless, predicting these trajectories is challenging due to variable tumor margins and dynamic visual conditions. To address this issue, we create the ESD Trajectory and Confidence Map-based Safety Margin (ETSM) dataset with $1849$ short clips, focusing on submucosal dissection with a dual-arm robotic system. We also introduce a framework that combines optimal dissection trajectory prediction with a confidence map-based safety margin, providing a more secure and intelligent decision-making tool to minimize surgical risks for ESD procedures. Additionally, we propose the Regression-based Confidence Map Prediction Network (RCMNet), which utilizes a regression approach to predict confidence maps for dissection areas, thereby delineating various levels of safety margins. We evaluate our RCMNet using three distinct experimental setups: in-domain evaluation, robustness assessment, and out-of-domain evaluation. Experimental results show that our approach excels in the confidence map-based safety margin prediction task, achieving a mean absolute error (MAE) of only $3.18$. To the best of our knowledge, this is the first study to apply a regression approach for visual guidance concerning delineating varying safety levels of dissection areas. Our approach bridges gaps in current research by improving prediction accuracy and enhancing the safety of the dissection process, showing great clinical significance in practice.

机器人手术图像分割医疗AI安全边界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。