实时追踪导管尖端,助力机器人自动取栓
Towards Real-Time Autonomous Navigation: Transformer-Based Catheter Tip Tracking in Fluoroscopy

- 用多线程流水线融合深度学习分割与后处理,实现荧光下导管尖端实时定位
- 两分类SegFormer模型误差仅4.44毫米,优于U-Net等其他模型
- 适合开发自主介入机器人系统,尤其适用于低对比度、遮挡等复杂场景
目的:机械取栓可改善卒中预后,但受限于局部治疗资源不足。通过部署基于强化学习的机器人系统可缓解此问题,但现有RL方法需实时追踪导管尖端位置才能运行。本文旨在开发并评估一种在荧光透视下实现导管尖端实时追踪的系统,应对低对比度、噪声和设备遮挡等挑战。方法:设计多线程处理流水线,包含帧读取、预处理、推理与后处理。训练并比较了U-Net、U-Net+Transformer和SegFormer三种分割模型,采用二分类与三分类两种形式。后处理包括两步组件过滤、单像素中轴骨架化及贪婪弧长路径追踪,辅以轮廓回退机制。结果:在人工标注的中等复杂度荧光视频数据上,二分类SegFormer模型均方误差为4.44毫米,优于U-Net(4.60毫米)、U-Net+Transformer(6.20毫米)以及所有三分类模型(5.19–7.74毫米)。在分割基准测试中,该系统在三段分割任务上达到最高5%的Dice分数提升,超过现有CathAction基准。结论:所提多线程追踪框架在复杂成像条件下表现稳定,性能超越既有基准,为基于强化学习的自主机械取栓导航提供了可靠高效的基础。
原文摘要 · Abstract (English)
Purpose: Mechanical thrombectomy (MT) improves stroke outcomes, but is limited by a lack of local treatment access. Widespread distribution of reinforcement learning (RL)-based robotic systems can be used to alleviate this challenge through autonomous navigation, but current RL methods require live device tip coordinate tracking to function. This paper aims to develop and evaluate a real-time catheter tip tracking pipeline under fluoroscopy, addressing challenges such as low contrast, noise, and device occlusion. Methods: A multi-threaded pipeline was designed, incorporating frame reading, preprocessing, inference, and post-processing. Deep learning segmentation models, including U-Net, U-Net+Transformer, and SegFormer, were trained and benchmarked using two-class and three-class formulations. Post-processing involved two-step component filtering, one-pixel medial skeletonization, and greedy arc-length path following with contour fall-back. Results: On manually-labeled moderate complexity fluoroscopic video data, the two-class SegFormer achieved a mean absolute error of 4.44 mm, outperforming U-Net (4.60 mm), U-Net+Transformer (6.20 mm) and all three-class models (5.19-7.74 mm). On segmentation benchmarks, the system exceeded state-of-the-art CathAction results with improvements of up to +5% in Dice scores for three-segmentation. Conclusion: The results demonstrate that the proposed multi-threaded tracking framework maintains stable performance under challenging imaging conditions, outperforming prior benchmarks, while providing a reliable and efficient foundation for RL-based autonomous MT navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。