arXiv:2603.29990cs.CV2026-03被引 1

基于头戴AR的手术导航框架,实现毫米级精准定位与实时可视化。

SurgNavAR: An Augmented Reality Surgical Navigation Framework for Optical See-Through Head Mounted Displays

  • 用2D图案标记患者和器械,结合校准技术实现高精度追踪
  • 在模拟实验中达到1毫米工具校准、3毫米配准、5毫米定位精度
  • 开源易用,适配多种手术场景,适合医疗设备开发者使用

带有头戴式显示器(HMD)的增强现实(AR)设备可在手术中直接将术前三维影像叠加到患者身上。为使HMD-AR设备作为独立手术导航系统,需具备患者与手术器械定位、影像与患者对齐、实时可视化导航数据的能力。尽管部分技术已成熟,但集成复杂且需专业知识,阻碍该领域发展。本文提出并评估了一个集成的基于HMD的AR手术导航框架,可适应多种外科应用。该框架通过贴附于患者和器械上的2D图案作为参考标记进行追踪,支持基于枢轴和参考点的器械校准技术,并采用基于点匹配与手动定位的方式完成影像-患者配准。框架在两种HMD设备(HoloLens 2与Magic Leap 2)上进行了评估,涵盖两个临床场景:AR引导穿刺与肋骨骨折定位。结果显示,工具尖端校准均值误差为1 mm,配准误差为3 mm,靶向精度低于5 mm。该框架为基于HMD的AR手术导航提供了一个易用、可配置的工具,可扩展至多种外科应用。代码已公开于https://github.com/abdullahthabit/SurgNavAR。

原文摘要 · Abstract (English)

Augmented reality (AR) devices with head mounted displays (HMDs) facilitate the direct superimposition of 3D preoperative imaging data onto the patient during surgery. To use an HMD-AR device as a stand-alone surgical navigation system, the device should be able to locate the patient and surgical instruments, align preoperative imaging data with the patient, and visualize navigation data in real time during surgery. Whereas some of the technologies required for this are known, integration in such devices is cumbersome and requires specific knowledge and expertise, hampering scientific progress in this field. This work therefore aims to present and evaluate an integrated HMD-based AR surgical navigation framework that is adaptable to diverse surgical applications. The framework tracks 2D patterns as reference markers attached to the patient and surgical instruments. It allows for the calibration of surgical tools using pivot and reference-based calibration techniques. It enables image-to-patient registration using point-based matching and manual positioning. The integrated functionalities of the framework are evaluated on two HMD devices, the HoloLens 2 and Magic Leap 2, with two surgical use cases being evaluated in a phantom setup: AR-guided needle insertion and rib fracture localization. The framework was able to achieve a mean tooltip calibration accuracy of 1 mm, a registration accuracy of 3 mm, and a targeting accuracy below 5 mm on the two surgical use cases. The framework presents an easy-to-use configurable tool for HMD-based AR surgical navigation, which can be extended and adapted to many surgical applications. The framework is publicly available at https://github.com/abdullahthabit/SurgNavAR.

手术导航AR技术头戴设备医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。