轻量级模型实现多器官同步CT图像配准,通用性强且显存需求低。
TotalRegistrator: Towards a Lightweight Foundation Model for CT Image Registration
- 基于UNet与场分解策略,一次处理多个解剖区域。
- 训练仅需11GB显存,在自建数据集上多器官配准性能更优。
- 无需微调即可在外部数据集上保持竞争力,适合临床通用场景。
图像配准是临床纵向及多时相CT分析的核心技术,但现有方法多针对单一器官,泛化能力受限。本文提出TotalRegistrator,一种基于标准UNet架构和新型场分解策略的图像配准框架,可同时对多个解剖区域进行配准,模型轻量,训练仅需11GB GPU内存。为验证方法,构建了包含695例全身(胸腹盆)配对CT扫描的大规模纵向数据集。在自建数据集上,该方法在多器官腹部配准中普遍优于基线模型,肺部对齐性能略有下降;在三个外部数据集(来自Learn2Reg挑战的胸部和腹部公开数据集,以及合作医院的私有多时相腹部数据集)上,未经过微调即达到领先单器官模型的水平,展现出强泛化能力。代码将开源。
原文摘要 · Abstract (English)
Image registration is a fundamental technique in the analysis of longitudinal and multi-phase CT images within clinical practice. However, most existing methods are tailored for single-organ applications, limiting their generalizability to other anatomical regions. This work presents TotalRegistrator, an image registration framework capable of aligning multiple anatomical regions simultaneously using a standard UNet architecture and a novel field decomposition strategy. The model is lightweight, requiring only 11GB of GPU memory for training. To train and evaluate our method, we constructed a large-scale longitudinal dataset comprising 695 whole-body (thorax-abdomen-pelvic) paired CT scans from individual patients acquired at different time points. We benchmarked TotalRegistrator against a generic classical iterative algorithm and a recent foundation model for image registration. To further assess robustness and generalizability, we evaluated our model on three external datasets: the public thoracic and abdominal datasets from the Learn2Reg challenge, and a private multiphase abdominal dataset from a collaborating hospital. Experimental results on the in-house dataset show that the proposed approach generally surpasses baseline methods in multi-organ abdominal registration, with a slight drop in lung alignment performance. On out-of-distribution datasets, it achieved competitive results compared to leading single-organ models, despite not being fine-tuned for those tasks, demonstrating strong generalizability. The source code will be publicly available at: https://github.com/DIAGNijmegen/oncology_image_registration.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。