用注意力机制精准识别心导管和器械,实时检测精度超87%
Attention on the Wires (AttWire): A Foundation Model for Detecting Devices and Catheters in X-ray Fluoroscopic Images
- 设计多尺度高斯导数注意力模块,引导模型聚焦导线区域
- 在12,438张图像上实现99.8%导管检测成功率,58帧/秒实时运行
- 适合临床实时导航与机器人手术,代码已开源
微创心血管手术中常用介入器械、导管及可植入成像设备(如经食道超声探头)。准确检测其在X射线透视图像中的位置与方向对多种临床应用至关重要。本文提出一种新型注意力机制,引导卷积神经网络聚焦于图像中导线区域——几乎所有心血管介入器械均含导线。该机制结合多尺度高斯导数滤波器与点积注意力层,构建轻量级基础模型,实现多目标同步高精度、实时检测。模型在总计12,438张X射线图像上进行训练与测试,检测经食道超声探头的准确率达0.88(以交并比IoU衡量),人工瓣膜检测准确率为0.87,58帧/秒实时运行。10电极导管检测成功率达99.8%,消融导管检测成功率为97.8%。结果表明,本模型可在实时透视图像中同时检测并识别各类介入器械与柔性导管。该方法通过创新注意力机制实现高性能目标检测,适用于多种临床场景与机器人辅助手术。代码已公开于https://github.com/YingLiangMa/AttWire。
原文摘要 · Abstract (English)
Objective: Interventional devices, catheters and insertable imaging devices such as transesophageal echo (TOE) probes are routinely used in minimally invasive cardiovascular procedures. Detecting their positions and orientations in X-ray fluoroscopic images is important for many clinical applications. Method: In this paper, a novel attention mechanism was designed to guide a convolution neural network (CNN) model to the areas of wires in X-ray images, as nearly all interventional devices and catheters used in cardiovascular procedures contain wires. The attention mechanism includes multi-scale Gaussian derivative filters and a dot-product-based attention layer. By utilizing the proposed attention mechanism, a lightweight foundation model can be created to detect multiple objects simultaneously with higher precision and real-time speed. Results: The proposed model was trained and tested on a total of 12,438 X-ray images. An accuracy of 0.88 was achieved for detecting an echo probe and 0.87 for detecting an artificial valve at 58 FPS. The accuracy was measured by intersection-over-union (IoU). We also achieved a 99.8% success rate in detecting a 10-electrode catheter and a 97.8% success rate in detecting an ablation catheter. Conclusion: Our detection foundation model can simultaneously detect and identify both interventional devices and flexible catheters in real-time X-ray fluoroscopic images. Significance: The proposed model employs a novel attention mechanism to achieve high-performance object detection, making it suitable for various clinical applications and robotic-assisted surgeries. Codes are available at https://github.com/YingLiangMa/AttWire.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。