用2D生成器+跨切片特征轨迹,低成本实现高分辨率3D医学图像合成。
LiFT: Lifted Inter-slice Feature Trajectories for 3D Image Generation from 2D Generators

- 将3D体积生成拆解为单切片生成与切片间特征轨迹学习
- 在BraTS和SynthRAD数据集上实现接近高质量重建的连贯性,推理成本降低135倍
- 适合需要高效3D医学图像生成的研究者或临床应用开发者
高分辨率3D医学图像生成仍具挑战:全体积模型计算开销大,而高效的2D切片生成器常无法保持第三维度的解剖一致性。本文提出LiFT框架,通过分解3D体积合成为单切片图像生成与切片间特征轨迹学习。不直接建模体积分布,而是将体积视为特征空间中的有序轨迹,捕捉解剖结构在深度方向上的出现、演变与消失过程。引入三平面漂移损失,对齐生成切片与真实体积的轨迹,实现无条件生成中的分布学习;在配对翻译任务中,使用双向z-上下文混合器对抗注册目标,实现跨平面一致性并保持单切片保真度。在BraTS 2023(无条件生成与缺失模态MRI)和SynthRAD2023(MRI到CT)上评估,结果表明LiFT保持单切片质量,其缺失模态重建性能接近报告的cWDM水平,且推理成本仅为约1/135,同时在MR-to-CT任务中显著提升跨平面连贯性,验证了轻量级切片间轨迹学习在高分辨率3D医学合成中的可行性。
原文摘要 · Abstract (English)
High-resolution 3D medical image generation remains challenging because fully volumetric models are computationally expensive, while efficient 2D slice generators often fail to preserve anatomical consistency across the third dimension. We propose LiFT, a framework for Lifted inter-slice Feature Trajectories that factorizes 3D volume synthesis into per-slice image generation and inter-slice trajectory learning. Rather than modeling the volumetric distribution end-to-end, LiFT treats a volume as an ordered trajectory in feature space, capturing how anatomical structures appear, transform, and disappear across depth. A tri-planar drifting loss aligns the trajectory of generated slices with the trajectories of real volumes, enabling distributional learning over inter-slice progressions in unconditional generation; in paired translation, a bidirectional $z$-context mixer trained against the registered target supplies through-plane coherence while preserving per-slice fidelity. We evaluate LiFT on BraTS 2023 (unconditional and missing-modality MR) and SynthRAD2023 (MR-to-CT). Across these settings, LiFT preserves per-slice quality, approaches the reported cWDM missing-MR reconstruction quality at $\sim$$135\times$ lower inference cost (without formal equivalence testing), and improves through-plane coherence on MR-to-CT relative to a no-mapper ablation, demonstrating that lightweight inter-slice trajectory learning is a viable route to high-resolution 3D medical synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。