用XR实现心内超声导管6自由度实时追踪,提升介入手术训练可视化效果。
Advanced XR-Based 6-DOF Catheter Tracking System for Immersive Cardiac Intervention Training
- 通过双摄像机+视觉算法实现导管3D轨迹与旋转角实时重建
- 导管尖端定位精度达亚毫米级,支持动态3D心模型交互
- 实验证明3D视图虽非必优,但对术前规划和训练价值显著
扩展现实(XR)技术正成为复杂心脏介入手术培训与操作引导的有效工具。本文提出一种新型系统,用于实时三维追踪与可视化心内超声(ICE)导管,精确测量其滚转角。系统采用定制3D打印装置搭配正交摄像头,获取导管的双平面视频;通过专用计算机视觉算法重建其3D轨迹,实现导管尖端亚毫米级定位及滚动角的实时追踪。系统数据集成至基于Unity的交互环境,通过Meta Quest 3 XR头显呈现,结合动态追踪导管与患者特异性3D心脏模型。该沉浸式环境用于测试3D深度感知在XR可视化中的作用,相较于2D投影的优势。六名心脏病专家参与的实验表明,尽管3D可视化并非在所有情境下优于2D视图,但所有参与者均认可其在术前训练、规划及术中导航中的实用性。该系统在提升导管介入手术可视化、交互性与技能培养方面展现出显著潜力,尤其适用于ICE操作。
原文摘要 · Abstract (English)
Extended Reality (XR) technologies are gaining traction as effective tools for medical training and procedural guidance, particularly in complex cardiac interventions. This paper presents a novel system for real-time 3D tracking and visualization of intracardiac echocardiography (ICE) catheters, with precise measurement of the roll angle. A custom 3D-printed setup, featuring orthogonal cameras, captures biplane video of the catheter, while a specialized computer vision algorithm reconstructs its 3D trajectory, localizing the tip with sub-millimeter accuracy and tracking the roll angle in real-time. The system's data is integrated into an interactive Unity-based environment, rendered through the Meta Quest 3 XR headset, combining a dynamically tracked catheter with a patient-specific 3D heart model. This immersive environment allows the testing of the importance of 3D depth perception, in comparison to 2D projections, as a form of visualization in XR. Our experimental study, conducted using the ICE catheter with six participants, suggests that 3D visualization is not necessarily beneficial over 2D views offered by the XR system; although all cardiologists saw its utility for pre-operative training, planning, and intra-operative guidance. The proposed system qualitatively shows great promise in transforming catheter-based interventions, particularly ICE procedures, by improving visualization, interactivity, and skill development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。