用一张X光片补全超声看不清的脊椎结构,实现无注册的精准术中导航。
US-X Complete: A Multi-Modal Approach to Anatomical 3D Shape Recovery
- 融合单张X光与超声图像,通过深度学习恢复被骨骼遮挡的脊椎3D形态。
- 在模拟数据上重建误差降低37%,显著优于现有方法(p<0.001)。
- 适合需要实时、无辐射脊柱成像的手术导航场景,如微创脊柱手术。
超声可在术中无辐射、低成本地实时显示脊柱骨性标志、椎旁软组织及神经血管结构,但因骨骼导致的声影效应,难以完整呈现椎体等骨性结构。本文提出一种新颖的多模态深度学习方法,利用单张侧位X光片提供的互补信息,完成3D超声中被遮挡的解剖结构。为支持训练,我们生成了配对数据:(1) 模拟X光扫描的2D侧位椎体视图,(2) 模拟超声成像中有限可视性和遮挡的3D部分椎体表示。该方法整合两种模态的形态信息,在3D超声椎体补全任务中显著优于当前最优方法(p < 0.001)。我们通过假体实验验证了初步临床转化可行性,实现了无需与术前CT等模态配准的、更准确完整的腰椎三维可视化叠加于超声图像之上。结果表明,引入单张投影X光可有效缓解超声核心局限,同时保留其作为主成像模态的优势。代码与数据见https://github.com/miruna20/US-X-Complete。
原文摘要 · Abstract (English)
Ultrasound offers a radiation-free, cost-effective solution for real-time visualization of spinal landmarks, paraspinal soft tissues and neurovascular structures, making it valuable for intraoperative guidance during spinal procedures. However, ultrasound suffers from inherent limitations in visualizing complete vertebral anatomy, in particular vertebral bodies, due to acoustic shadowing effects caused by bone. In this work, we present a novel multi-modal deep learning method for completing occluded anatomical structures in 3D ultrasound by leveraging complementary information from a single X-ray image. To enable training, we generate paired training data consisting of: (1) 2D lateral vertebral views that simulate X-ray scans, and (2) 3D partial vertebrae representations that mimic the limited visibility and occlusions encountered during ultrasound spine imaging. Our method integrates morphological information from both imaging modalities and demonstrates significant improvements in vertebral reconstruction (p < 0.001) compared to state of art in 3D ultrasound vertebral completion. We perform phantom studies as an initial step to future clinical translation, and achieve a more accurate, complete volumetric lumbar spine visualization overlayed on the ultrasound scan without the need for registration with preoperative modalities such as computed tomography. This demonstrates that integrating a single X-ray projection mitigates ultrasound's key limitation while preserving its strengths as the primary imaging modality. Code and data can be found at https://github.com/miruna20/US-X-Complete
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。