用AR增强的3D触控界面让机器人超声操作更准更省力。
Evaluation of Augmented Reality-based Intuitive Interface for Robot-Assisted Transesophageal Echocardiography: A User Study
- 用AR+3D可视化和探头尖端直接控制提升操作直观性
- 位置误差从13毫米降至3毫米,方向误差减半
- 适合心血管介入医生和机器人手术系统研发者
经食管超声心动图(TEE)对结构性心脏病干预的诊断与引导至关重要。然而,手动操作需要高超技能,体力负担重,且与透视结合时会暴露于辐射。机器人辅助TEE系统可改善探头操控并减轻疲劳,但直观有效的用户界面设计仍是难题。本研究提出并评估了一种基于增强现实(AR)的模型增强型直观界面,旨在提升空间感知与操作直观性。使用集成电磁追踪与虚拟模拟器的机器人TEE平台,对比三种界面:2D关节级(2D-JI)、3D关节级(3D-JI)和3D尖端级(3D-TI)。36名参与者完成标准化导航任务以重现目标超声视角,性能通过位置与方向误差、完成时间及NASA-TLX工作负荷评分评估。结果显示,3D可视化显著提升空间精度,中位位置误差由13毫米降至3毫米,方向误差减半;尖端级控制进一步降低50%方向误差,并减少个体间差异。总体而言,3D-TI配置在沉浸式可视化与直接尖端控制结合下表现最优,支持将AR可视化与直观控制整合至下一代机器人TEE系统,提升操作性能与手术安全性。
原文摘要 · Abstract (English)
TransEsophageal Echocardiography (TEE) is essential for diagnosing and guiding Structural Heart Disease (SHD) interventions. However, manual TEE manipulation demands significant operator expertise, is physically demanding, and exposes clinicians to radiation when performed alongside fluoroscopy. Robotic-assisted TEE systems have been introduced to improve probe handling and reduce operator fatigue, yet the design of intuitive and effective user interfaces remains an open challenge. This study presents and evaluates a model-enhanced, Augmented Reality (AR)-based intuitive interface for robot-assisted TEE, designed to improve spatial awareness and control intuitiveness. A robotic TEE platform integrated with electromagnetic tracking and a virtual simulator was used to compare three user interfaces differing in visualization and interaction modalities: 2D jointlevel (2D-JI), 3D joint-level (3D-JI), and 3D tip-level (3D-TI). Thirty six participants performed standardized navigation tasks to reproduce target echocardiographic views, with performance assessed via position and orientation errors, completion time, and NASA-TLX workload scores. Results show that 3D visualization significantly improved spatial accuracy, reducing median position error from 13 mm to 3 mm and halving the orientation error compared with the 2D interface. Tip-level interaction yielded a further 50% reduction in orientation error and reduced interuser variability relative to joint-level control. Overall, the 3D-TI configuration, combining immersive visualization with direct tip-level control, proved the most effective and ergonomic interface, supporting the integration of AR-based visualization and intuitive control paradigms into next-generation robotic TEE systems to enhance operator performance and procedural safety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。