仅用一张X光片,高保真重建3D骨骼,兼顾精度与解剖合理性。
X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methods
- 融合卷积神经网络与模板引导非刚性配准,实现从2D X光到3D骨骼的高精度重建
- 在临床数据上达到0.952 IoU和0.005 Chamfer-L1,优于当前主流方法
- 结合解剖先验与生物力学模板,提升肋骨弯曲和椎体对齐的视觉真实感
从单张平面X光片精确重建3D骨骼仍面临解剖复杂性和输入信息有限的挑战。本文提出X2BR,一种混合神经隐式框架,结合连续体素重建与模板引导的非刚性配准。核心网络X2B采用基于ConvNeXt的编码器,从X光中提取空间特征,并预测无需依赖统计形状模型的高保真3D骨骼占据场。为进一步提升解剖准确性,X2BR引入基于YOLOv9检测和SKEL生物力学骨架模型构建的患者特异性模板网格。粗略重建通过基于测地线的相干点漂移与模板对齐,生成解剖一致的3D骨骼体积。在临床数据集上的实验表明,X2B取得最高数值精度,IoU达0.952,Chamfer-L1距离为0.005,优于近期基线如X2V和D2IM-Net。在此基础上,X2BR结合YOLOv9的骨骼检测与生物力学模板对齐引入解剖先验,虽在IoU上略有下降(0.875),但在肋骨曲率与椎体对齐等解剖细节上展现出更优的视觉一致性。该数值精度与视觉真实性之间的权衡凸显了混合框架在临床相关3D重建中的价值。
原文摘要 · Abstract (English)
Accurate 3D bone reconstruction from a single planar X-ray remains a challenge due to anatomical complexity and limited input data. We propose X2BR, a hybrid neural implicit framework that combines continuous volumetric reconstruction with template-guided non-rigid registration. The core network, X2B, employs a ConvNeXt-based encoder to extract spatial features from X-rays and predict high-fidelity 3D bone occupancy fields without relying on statistical shape models. To further refine anatomical accuracy, X2BR integrates a patient-specific template mesh, constructed using YOLOv9-based detection and the SKEL biomechanical skeleton model. The coarse reconstruction is aligned to the template using geodesic-based coherent point drift, enabling anatomically consistent 3D bone volumes. Experimental results on a clinical dataset show that X2B achieves the highest numerical accuracy, with an IoU of 0.952 and Chamfer-L1 distance of 0.005, outperforming recent baselines including X2V and D2IM-Net. Building on this, X2BR incorporates anatomical priors via YOLOv9-based bone detection and biomechanical template alignment, leading to reconstructions that, while slightly lower in IoU (0.875), offer superior anatomical realism, especially in rib curvature and vertebral alignment. This numerical accuracy vs. visual consistency trade-off between X2B and X2BR highlights the value of hybrid frameworks for clinically relevant 3D reconstructions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。