arXiv:2609.09010cs.CV2026-09

用联合2D-3D模型从X光片快速重建股骨,速度提升4倍且更准确。

A Joint 2D-3D Statistical Shape Model for Orthopedic Reconstruction

论文配图:A Joint 2D-3D Statistical Shape Model for Orthopedic Reconstruction
图 1 · 摘自论文原文
  • 构建2D与3D形状的共享潜空间,直接学习两者映射关系。
  • 在NMDID数据集上重建误差降低,单例推理时间不足3秒。
  • 适合需要快速精准骨骼重建的临床手术规划场景。

从X光片进行三维股骨重建有助于手术规划、假体尺寸选择和术后随访,但因投影丢失深度信息而难以求解。现有方法常依赖3D统计形状模型(SSM)作为形状先验,通过迭代3D到2D投影匹配实现重建,但计算成本高且限制于单一维度,未充分利用2D观测与3D几何间的统计关联。本文提出一种联合2D-3D SSM,显式建模2D与3D分割在共享潜空间中的协变关系。训练时,将2D与3D分割注册至同一3D模板及其对应的2D投影,并使用主成分分析(PCA)联合分解其形变场。该联合建模使2D到3D的映射可直接从数据中学习,无需推理时建立对应关系。对于新样本,3D形状通过将2D潜坐标直接提升至3D PCA子空间恢复,避免了迭代3D到2D投影过程。在NMDID数据集上的实验表明,所提方法优于广泛使用的3D-only SSM基线,推理速度提升约4倍,单例耗时低于3秒。代码已公开:https://github.com/florence-dellaniello-picard/joint2d3d-ssm。

原文摘要 · Abstract (English)

Three-dimensional femoral reconstruction from radiographs supports surgical planning, implant sizing, and post-operative follow-up, but remains ill-posed as X-ray projections discard depth information. Existing methods often incorporate a 3D statistical shape model (SSM) as a shape prior to guide reconstructions toward anatomically plausible shapes, relying on iterative 3D-to-2D projection matching. Yet, these approaches are computationally expensive and constrain their SSM to a single dimensionality, leaving the statistical relationship between 2D observations and 3D geometry largely unexploited and unexplored. We instead propose a joint 2D-3D SSM that explicitly captures the co-variation between 2D and 3D segmentations in a shared latent space. During training, 2D and 3D segmentations are registered to a common 3D template and its corresponding 2D projections, and the resulting stationary velocity fields are jointly decomposed using principal component analysis (PCA). This joint modeling allows the 2D-to-3D mapping to be learned directly from data rather than computing correspondences at inference time. For unseen subjects, the 3D shape is recovered directly by lifting the 2D latent coordinates to the 3D PCA subspace, thereby eliminating the need for iterative 3D-to-2D projection. Experiments on NMDID demonstrate that the proposed joint 2D-3D SSM outperforms a widely-used 3D-only SSM baseline while achieving inference approximately 4 times faster, at under 3 seconds per subject. The code is available at: https://github.com/florence-dellaniello-picard/joint2d3d-ssm.

3D重建医学影像统计形状模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。