用数据驱动方法提升手术导航变形建模精度与效率,支持医生实时干预。
Toward Reliable AR-Guided Surgical Navigation: Interactive Deformation Modeling with Data-Driven Biomechanics and Prompts
- 融合数据驱动生物力学与物理模型,兼顾精度与计算速度。
- 平均定位误差降至2.78毫米,优于现有方法。
- 医生可交互提示修正偏差,适合复杂手术场景下的临床使用。
在增强现实(AR)引导的手术导航中,术前器官模型需与术中动态解剖结构对齐,以可视化血管、肿瘤等关键结构。准确的变形建模对保持AR叠加可靠性至关重要。尽管有限元法(FEM)具有物理合理性,但其高计算开销限制了术中应用。现有算法难以处理气腹或韧带切断等大范围解剖变化,导致配准失准,影响导航精度。为此,本文提出一种数据驱动的生物力学算法,在保持FEM级精度的同时提升计算效率。同时引入人机协同机制,允许外科医生在变形过程中提供交互式提示,以纠正解剖错位,结合临床经验实现动态适应。在公开数据集上的实验表明,该方法平均目标注册误差为3.42毫米;通过交互框架引入医生提示后,误差进一步降至2.78毫米,显著优于当前最优方法,在体积精度上表现突出。结果验证了本框架在高效、精准建模及医算协同方面的潜力,推动更安全可靠的计算机辅助手术发展。
原文摘要 · Abstract (English)
In augmented reality (AR)-guided surgical navigation, preoperative organ models are superimposed onto the patient's intraoperative anatomy to visualize critical structures such as vessels and tumors. Accurate deformation modeling is essential to maintain the reliability of AR overlays by ensuring alignment between preoperative models and the dynamically changing anatomy. Although the finite element method (FEM) offers physically plausible modeling, its high computational cost limits intraoperative applicability. Moreover, existing algorithms often fail to handle large anatomical changes, such as those induced by pneumoperitoneum or ligament dissection, leading to inaccurate anatomical correspondences and compromised AR guidance. To address these challenges, we propose a data-driven biomechanics algorithm that preserves FEM-level accuracy while improving computational efficiency. In addition, we introduce a novel human-in-the-loop mechanism into the deformation modeling process. This enables surgeons to interactively provide prompts to correct anatomical misalignments, thereby incorporating clinical expertise and allowing the model to adapt dynamically to complex surgical scenarios. Experiments on a publicly available dataset demonstrate that our algorithm achieves a mean target registration error of 3.42 mm. Incorporating surgeon prompts through the interactive framework further reduces the error to 2.78 mm, surpassing state-of-the-art methods in volumetric accuracy. These results highlight the ability of our framework to deliver efficient and accurate deformation modeling while enhancing surgeon-algorithm collaboration, paving the way for safer and more reliable computer-assisted surgeries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。