用立体深度图检测手术机器人工具与组织接触,效果更稳定且可迁移。
Transferable Tool-Tissue Contact Detection from Stereo Depth in Robot-Assisted Surgery

- 基于立体深度图提取工具边界最小距离信号,构建可迁移的接触判断模型。
- 在4个新会话上实现宏F1 0.927、AUPRC 0.980,显著优于传统方法。
- 适合需要跨任务、跨物体泛化的手术机器人触觉感知系统开发。
可靠的工具-组织接触检测可支持交互感知控制和下游力估计。现有方法多依赖RGB外观学习接触分类器,泛化能力差。本文利用立体相机生成的深度图,对每个深度帧在工具边界附近定位空间支持的最小距离区域,压缩为单一标量 $-"log_{10}|d|$;该信号与真实接触状态同步变化。我们构建全监督双状态隐马尔可夫模型,基于6次触诊会话(单个硅胶杯状假体)进行六折留一会话(LOSO)集成训练,决策阈值由交叉验证预测结果确定。在4个保留会话上评估:1. 同任务同假体;2. 同任务异假体;3. 异任务异假体。模型在保留会话上达到宏F1 0.927、AUPRC 0.980。对比先前基于RGB的方法,其在第一类任务上表现良好(F1 0.965),但在后两类大幅下降,整体宏F1仅0.320。结果表明,工具-组织距离是手术机器人中强而可迁移的接触检测线索。
原文摘要 · Abstract (English)
Reliable tool--tissue contact detection can support interaction-aware control and downstream force estimation in robot-assisted surgery. Most existing methods learn a contact classifier from RGB appearance, which is hard to generalize. In this work, we use the depth image generated from a stereo pair to give more information about tool--tissue contact. For each depth frame, we localize a spatially supported minimum-distance patch around the tool boundary and reduce it to a single scalar, $-\log_{10}|d|$; this signal rises and falls in step with ground-truth contact. We formalize this observation with a fully supervised two-state hidden Markov model. We fit this model as a six-fold leave-one-session-out (LOSO) ensemble on six palpation sessions against a single silicone cup-like phantom, with the decision threshold selected from the pooled out-of-fold predictions. It is evaluated on four held-out sessions of three categories: 1. same task on same phantom; 2. same task on different phantom; 3. different task on different phantom. This model reaches held-out macro F1 $0.927$ and AUPRC $0.980$. We further compare against a reproduction of an RGB-based contact classifier from prior work. This RGB-based model achieves high performance on the first category (F1 $0.965$), but substantially lower performance on the other two, resulting in macro F1 $0.320$ across all four sessions. These results indicate that the tool--tissue distance is a strong, transferable cue for contact detection in robot-assisted surgery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。