用稀疏任意角度X光实现术中3D脊柱重建,无需预训练
IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rays
- 基于高斯点云的实例化重建,不依赖大量标注数据
- 20至30张透视图像即可生成临床可用3D模型,视觉一致性提升
- 无需预训练,适配新患者,适合实时手术导航场景
脊柱手术风险高,需精确执行,常依赖影像导航系统。近年来,监督学习方法已用于从稀疏透视图像重建3D脊柱结构,显著降低对辐射剂量高的3D成像系统的依赖。然而,这些方法通常需要大量标注数据,且在不同患者解剖或成像条件下泛化能力差。本文提出基于高斯点云的实例化方法,扩展R²-Gaussian splatting框架,在稀疏、任意视角的真实术中X光下实现解剖一致的3D体数据重建。引入解剖引导的风格迁移标准化步骤,提升多视角视觉一致性,改善重建质量。该框架无需预训练,可直接适应新患者和解剖结构。在离体数据集上评估显示,使用20至30视图时,专家评价确认3D重建具有临床导航价值,且标准化显著增强解剖清晰度。定量指标(PSNR/SSIM)验证了与理想条件相比存在性能权衡,但标准化工序相比原始输入有明显提升。本工作证明了从任意稀疏视角X光实现实例化体重建的可行性,推动术中3D成像在导航中的应用。
原文摘要 · Abstract (English)
Spine surgery is a high-risk intervention demanding precise execution, often supported by image-based navigation systems. Recently, supervised learning approaches have gained attention for reconstructing 3D spinal anatomy from sparse fluoroscopic data, significantly reducing reliance on radiation-intensive 3D imaging systems. However, these methods typically require large amounts of annotated training data and may struggle to generalize across varying patient anatomies or imaging conditions. Instance-learning approaches like Gaussian splatting could offer an alternative by avoiding extensive annotation requirements. While Gaussian splatting has shown promise for novel view synthesis, its application to sparse, arbitrarily posed real intraoperative X-rays has remained largely unexplored. This work addresses this limitation by extending the $R^2$-Gaussian splatting framework to reconstruct anatomically consistent 3D volumes under these challenging conditions. We introduce an anatomy-guided radiographic standardization step using style transfer, improving visual consistency across views, and enhancing reconstruction quality. Notably, our framework requires no pretraining, making it inherently adaptable to new patients and anatomies. We evaluated our approach using an ex-vivo dataset. Expert surgical evaluation confirmed the clinical utility of the 3D reconstructions for navigation, especially when using 20 to 30 views, and highlighted the standardization's benefit for anatomical clarity. Benchmarking via quantitative 2D metrics (PSNR/SSIM) confirmed performance trade-offs compared to idealized settings, but also validated the improvement gained from standardization over raw inputs. This work demonstrates the feasibility of instance-based volumetric reconstruction from arbitrary sparse-view X-rays, advancing intraoperative 3D imaging for surgical navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。