用ConvNeXt构建3D生成网络,统一实现MRI与CBCT转CT,提升放疗图像精度。
GANeXt: A Fully ConvNeXt-Enhanced Generative Adversarial Network for MRI- and CBCT-to-CT Synthesis
- 采用3D ConvNeXt堆叠的U型生成器,结合条件PatchGAN判别器。
- 在多模态数据上训练,MRI-to-CT和CBCT-to-CT均达到高保真度重建。
- 适用于放疗规划中需跨模态图像转换的临床场景。
从磁共振成像(MRI)和锥形束CT(CBCT)合成计算机断层扫描(CT)在自适应放疗中至关重要,可提供准确的解剖结构信息。本文提出GANeXt,一种基于3D局部块的全ConvNeXt增强生成对抗网络,实现跨模态、跨解剖区域的统一CT合成。GANeXt使用由3D ConvNeXt模块堆叠而成的高效U型生成器,判别器采用条件PatchGAN。为提升合成质量,引入多任务损失组合:均方误差(MAE)、感知损失、基于分割掩码的MAE、对抗损失,以及多头分割判别器的Dice损失与交叉熵。训练采用8样本批次,生成器与判别器分别使用AdamW优化器,学习率分别为$5\times10^{-4}$和$1\times10^{-3}$,并配备预热+余弦衰减调度器。数据预处理包括可变形配准、前景裁剪、输入模态百分位归一化,以及将CT线性归一化至[-1024, 1000]范围。数据增强包含随机缩放(0.8~1.3,仅限MRI-to-CT)、固定尺寸裁剪(MRI-to-CT为32×160×192,CBCT-to-CT为32×128×128)及随机翻转。推理阶段采用滑动窗口策略,重叠率0.8,平均折叠重建全尺寸sCT,并逆变换CT归一化。在无微调情况下联合训练所有区域,最终模型于第3000轮(MRI-to-CT)与第1000轮(CBCT-to-CT)选取,使用完整训练集。
原文摘要 · Abstract (English)
The synthesis of computed tomography (CT) from magnetic resonance imaging (MRI) and cone-beam CT (CBCT) plays a critical role in clinical treatment planning by enabling accurate anatomical representation in adaptive radiotherapy. In this work, we propose GANeXt, a 3D patch-based, fully ConvNeXt-powered generative adversarial network for unified CT synthesis across different modalities and anatomical regions. Specifically, GANeXt employs an efficient U-shaped generator constructed from stacked 3D ConvNeXt blocks with compact convolution kernels, while the discriminator adopts a conditional PatchGAN. To improve synthesis quality, we incorporate a combination of loss functions, including mean absolute error (MAE), perceptual loss, segmentation-based masked MAE, and adversarial loss and a combination of Dice loss and cross-entropy for multi-head segmentation discriminator. For both tasks, training is performed with a batch size of 8 using two separate AdamW optimizers for the generator and discriminator, each equipped with a warmup and cosine decay scheduler, with learning rates of $5\times10^{-4}$ and $1\times10^{-3}$, respectively. Data preprocessing includes deformable registration, foreground cropping, percentile normalization for the input modality, and linear normalization of the CT to the range $[-1024, 1000]$. Data augmentation involves random zooming within $(0.8, 1.3)$ (for MRI-to-CT only), fixed-size cropping to $32\times160\times192$ for MRI-to-CT and $32\times128\times128$ for CBCT-to-CT, and random flipping. During inference, we apply a sliding-window approach with $0.8$ overlap and average folding to reconstruct the full-size sCT, followed by inversion of the CT normalization. After joint training on all regions without any fine-tuning, the final models are selected at the end of 3000 epochs for MRI-to-CT and 1000 epochs for CBCT-to-CT using the full training dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。