arXiv:2607.27511cs.RO2026-07被引 2

用视觉动态建模检测手术机器人操作失败,无需故障数据即可精准预警。

Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modeling

论文配图:Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modeling
图 1 · 摘自论文原文
  • 基于流匹配的世界模型学习正常操作的视觉动态
  • 在真实与仿真环境中实现96.6%检测率、1.3%误报率
  • 适合高安全要求的自主手术机器人系统部署

模仿学习在自主手术机器人中展现出巨大潜力,但因手术任务的安全性要求高、环境复杂多变,安全部署仍具挑战。故障检测是关键保障,但受限于故障数据稀少、操作动态变化大,且需平衡漏检与误报。为此,我们提出FoMo-FD(基于流匹配的世界模型故障检测),通过动作条件化的流匹配模型学习短期视觉动态,利用观测终点潜在表示的逆传输非一致性进行窗口级检测,无需故障示范。检测阈值通过成功执行样本的分位数校准获得,实现任务特定报警且不预设未来故障类型。我们在da Vinci Research Kit(dVRK)上评估了四个手术相关操作任务,涵盖20种故障模式,结果表明FoMo-FD优于观察级异常基线和同一世界模型的预测误差变体,腕部摄像头视图表现最佳,达到96.6%故障检测率(FDR)和1.3%误报率(FAR)。

原文摘要 · Abstract (English)

Imitation learning has shown increasing promise for autonomous robotic surgery, yet safe deployment remains challenging due to the safety-critical nature of surgical tasks and the complexity and variability of surgical environments. Failure detection is therefore an essential safeguard, but its development remains difficult due to the challenges of scarce failure data, highly variable manipulation dynamics, and the need to balance missed detections against disruptive false alarms. To address these challenges, we introduce FoMo-FD (Flow-Matching World Model for Failure Detection), a failure detection method that learns nominal short-horizon visual dynamics with an action-conditioned flow-matching world model. FoMo-FD scores the inverse-transport nonconformity of observed endpoint latents, enabling window-level detection of visual-action inconsistencies without requiring failure demonstrations. Detection thresholds are obtained by conformal calibration on successful executions, yielding task-specific alarms without assuming future failure types. We evaluate FoMo-FD on four surgically relevant manipulation tasks with twenty failure modes across simulation and real-world experiments using the da Vinci Research Kit (dVRK). Results show that FoMo-FD outperforms observation-level anomaly baselines and a prediction-error variant of the same world model, with the wrist-camera view achieving the strongest performance, including a 96.6% failure detection rate (FDR) at a 1.3% false alarm rate (FAR).

手术机器人故障检测流匹配模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。