用无辐射的RGB-D数据完成脊椎三维重建,辅助手术导航。
SurgPointTransformer: Vertebrae Shape Completion with RGB-D Data
- 基于注意力机制的SurgPointTransformer,从局部可见表面推断完整脊椎形状。
- 在九个离体样本上实现5.39毫米的平均切比雪夫距离,精度显著领先。
- 适合需减少辐射暴露的骨科手术与机器人辅助系统开发人员。
当前计算机与机器人辅助手术系统依赖CT和荧光透视等成像技术生成患者解剖结构的高精度3D可视化,但这些技术基于电离辐射,对患者和医生造成辐射暴露。本研究提出一种无辐射替代方案,利用RGB-D数据重建3D脊柱解剖结构。受外科医生术中形成“三维认知地图”启发,我们提出SurgPointTransformer,一种用于手术场景的形状补全方法,可从部分可见表面准确重建未曝光区域。方法包含两个步骤:分割与形状补全。首先定位并分割脊柱整体,再进行逐椎体分割;随后将分割后的点云输入SurgPointTransformer,利用注意力机制学习可见表面特征与深层解剖结构之间的模式。评估采用九个离体样本的CT数据作为真实标签,结果表明,该方法显著优于现有基线模型,平均切比雪夫距离为5.39毫米,F-Score为0.85,地球移动距离为0.011,信噪比达22.90分贝。研究证明了该方法在3D腰椎完整重建及无辐射手术引导中的潜力,推动了计算机辅助与机器人辅助手术系统的感知与智能化发展。
原文摘要 · Abstract (English)
State-of-the-art computer- and robot-assisted surgery systems heavily depend on intraoperative imaging technologies such as CT and fluoroscopy to generate detailed 3D visualization of the patient's anatomy. While imaging techniques are highly accurate, they are based on ionizing radiation and expose patients and clinicians. This study introduces an alternative, radiation-free approach for reconstructing the 3D spine anatomy using RGB-D data. Drawing inspiration from the 3D "mental map" that surgeons form during surgeries, we introduce SurgPointTransformer, a shape completion approach for surgical applications that can accurately reconstruct the unexposed spine regions from sparse observations of the exposed surface. Our method involves two main steps: segmentation and shape completion. The segmentation step includes spinal column localization and segmentation, followed by vertebra-wise segmentation. The segmented vertebra point clouds are then subjected to SurgPointTransformer, which leverages an attention mechanism to learn patterns between visible surface features and the underlying anatomy. For evaluation, we utilize an ex-vivo dataset of nine specimens. Their CT data is used to establish ground truth data that were used to compare to the outputs of our methods. Our method significantly outperforms the state-of-the-art baselines, achieving an average Chamfer Distance of 5.39, an F-Score of 0.85, an Earth Mover's Distance of 0.011, and a Signal-to-Noise Ratio of 22.90 dB. This study demonstrates the potential of our reconstruction method for 3D vertebral shape completion. It enables 3D reconstruction of the entire lumbar spine and surgical guidance without ionizing radiation or invasive imaging. Our work contributes to computer-aided and robot-assisted surgery, advancing the perception and intelligence of these systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。