arXiv:2603.11404cs.ROcs.CV2026-03中稿 · IROS 2026

用进化算法提升手术器械实时追踪精度与速度

Real-time Rendering-based Surgical Instrument Tracking via Evolutionary Optimization

  • 结合CMA-ES进化优化与批量渲染,高效评估多种姿态候选
  • 在真实与合成数据上均实现更高追踪精度与更低延迟
  • 支持无关节角度与双人操作场景,适合手术视觉反馈

精准高效的手术器械追踪是机器人辅助微创手术的基础。尽管基于视觉的机器人位姿估计实现了无需标记的免物理标定,但因器械部分遮挡及特殊关节设计,可靠追踪仍具挑战。以往方法在视觉质量下降或数据稀缺时易出现特征误检,而基于渲染的方法则常面临计算开销大、收敛不佳的问题。本文将CMA-ES(一种进化优化策略)融入通用追踪流程,联合估计器械位姿与关节配置。通过批量渲染并行评估多个姿态候选,显著降低推理时间并增强收敛鲁棒性。该框架还可推广至无关节角与双人操作场景,适用于视觉反馈控制与在线手术视频标定。在合成与真实数据集上的大量实验表明,所提方法在精度与运行效率上均显著优于现有技术。源代码与数据见:https://github.com/hanyang-hu/online_dvrk_tracking。

原文摘要 · Abstract (English)

Accurate and efficient tracking of surgical instruments is fundamental for Robot-Assisted Minimally Invasive Surgery. Although vision-based robot pose estimation has enabled markerless calibration without tedious physical setups, reliable tool tracking for surgical robots still remains challenging due to partial visibility and specialized articulation design of surgical instruments. Previous works in the field are usually prone to unreliable feature detections under degraded visual quality and data scarcity, whereas rendering-based methods often struggle with computational costs and suboptimal convergence. In this work, we incorporate CMA-ES, an evolutionary optimization strategy, into a versatile tracking pipeline that jointly estimates surgical instrument pose and joint configurations. Using batch rendering to efficiently evaluate multiple pose candidates in parallel, the method significantly reduces inference time and improves convergence robustness. The proposed framework further generalizes to joint angle-free and bi-manual tracking settings, making it suitable for both vision feedback control and online surgery video calibration. Extensive experiments on synthetic and real-world datasets demonstrate that the proposed method significantly outperforms prior approaches in both accuracy and runtime. Source code and data are available at https://github.com/hanyang-hu/online_dvrk_tracking.

手术追踪进化算法实时渲染机器人手术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。