arXiv:2607.22803eess.IVcs.CV2026-07

用深度学习建立X光与CT骨结构的密集对应,实现无需重复扫描的精准定位。

Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bones

论文配图:Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bones
图 1 · 摘自论文原文
  • 训练共享权重模型学习跨患者骨结构的2D-3D密集对应关系
  • 在758例患者上训练后,对未见患者实现高精度姿态估计
  • 无需初始猜测或渲染,适合临床快速骨关节几何分析

从正位平片中恢复膝骨的6自由度姿态,结合术前分割的患者CT,可将低剂量影像转化为关节几何的定量测量,无需重复扫描或固定双平面装置。传统方法通过渲染骨轮廓与图像边缘对齐;近期方法则通过可微分X光渲染反向传播图像相似性损失优化姿态。两者均逐患者处理,单视角下易失效:轮廓存在深度歧义,可微渲染优化计算开销大且捕获范围窄。本文提出一种可泛化的、不依赖个体的密集2D-3D对应学习,仅基于投影几何监督。每类骨使用一个共享权重模型,在758名患者上训练,可注册训练外患者。姿态通过全局、无需初始化、无需渲染的PnP+RANSAC闭式求解获得。由于X光成像具有透射特性,对应目标为透射感知而非单一表面。尽管仅以配准为目标训练,该表示具解剖语义:简单分类器可从嵌入中读取地标解剖区域,相同特征在无骨骼标签情况下实现了2D-3D一致的身份区分。在大型单机构队列上,模型对未见患者表现出良好泛化能力。

原文摘要 · Abstract (English)

Recovering the 6-DoF pose of the knee bones from a plain radiograph, given the patient's segmented pre-operative CT, turns a routine low-dose image into a quantitative measurement of joint geometry, without the added dose of a repeat CT or a fixed biplanar rig. Classic solutions align a rendered bone silhouette to image edges; recent alternatives refine pose by backpropagating an image-similarity loss through a differentiable X-ray renderer. Both operate one patient at a time and are fragile under a single view. Silhouettes are depth-ambiguous, and differentiable-rendering refinement has a narrow capture range at substantial per-iteration cost. We instead learn an amortized, subject-agnostic dense 2D-3D correspondence, supervised solely by projection geometry. One shared-weight model per bone, trained across 758 patients, registers patients unseen during training. The pose then follows in closed form from a global, initialization-free, render-free PnP+RANSAC solve. Because X-ray formation is transmissive, our correspondence target is transmission-aware rather than tied to a single surface. Though trained only to register, the representation is anatomically semantic: a simple classifier reads a landmark's anatomical region from its embedding across held-out patients, and the same features separate the knee's bones into a 2D-3D-consistent identity learned without any bone label. On a large single-institution cohort the model generalizes well to held-out patients.

医学图像2D-3D配准膝关节深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。