arXiv:2502.05053cs.RO2025-02被引 12

用眼神追踪引导机器人超声,自动识别血管分支并稳定扫描。

Gaze-Guided Robotic Vascular Ultrasound Leveraging Human Intention Estimation

  • 通过眼动追踪捕捉操作者意图,指导机器人选择正确血管分支。
  • 在真实手臂假体上实现95%以上的血管定位准确率,优于传统方法。
  • 适合临床超声医生、机器人辅助医疗研究者使用。

医学超声广泛用于血管结构检查,但传统操作存在操作者间与操作者内差异。机器人超声系统(RUSS)凭借稳定性与可重复性成为潜在解决方案。由于人体血管解剖复杂,超声图像中常出现多条血管或单条血管分叉,增加了检查难度。为此,本文提出一种基于眼神引导的鲁棒性血管超声系统。通过眼动追踪设备采集操作者眼动信号,提取的注视信息用于引导机器人在分叉处选择目标血管。同时,设计了一种融合眼动信息的分割网络,提升分割鲁棒性。由于眼动信号通常噪声较大,本文提出一个稳定模块,将原始眼动数据转化为注意力热图,作为分割的区域建议,并在分叉出现时触发目标切换。为确保探头与表面接触良好,开发了基于超声置信度的自动姿态校正方法。实验表明,所提眼神引导分割流程显著优于对比方法;整体系统在具有不规则表面的真实手臂假体上验证,实现了95%以上的定位准确率。

原文摘要 · Abstract (English)

Medical ultrasound has been widely used to examine vascular structure in modern clinical practice. However, traditional ultrasound examination often faces challenges related to inter- and intra-operator variation. The robotic ultrasound system (RUSS) appears as a potential solution for such challenges because of its superiority in stability and reproducibility. Given the complex anatomy of human vasculature, multiple vessels often appear in ultrasound images, or a single vessel bifurcates into branches, complicating the examination process. To tackle this challenge, this work presents a gaze-guided RUSS for vascular applications. A gaze tracker captures the eye movements of the operator. The extracted gaze signal guides the RUSS to follow the correct vessel when it bifurcates. Additionally, a gaze-guided segmentation network is proposed to enhance segmentation robustness by exploiting gaze information. However, gaze signals are often noisy, requiring interpretation to accurately discern the operator's true intentions. To this end, this study proposes a stabilization module to process raw gaze data. The inferred attention heatmap is utilized as a region proposal to aid segmentation and serve as a trigger signal when the operator needs to adjust the scanning target, such as when a bifurcation appears. To ensure appropriate contact between the probe and surface during scanning, an automatic ultrasound confidence-based orientation correction method is developed. In experiments, we demonstrated the efficiency of the proposed gaze-guided segmentation pipeline by comparing it with other methods. Besides, the performance of the proposed gaze-guided RUSS was also validated as a whole on a realistic arm phantom with an uneven surface.

机器人超声眼动追踪血管分割医疗自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。