用预训练的通用模型实现无需训练的CT图像重建与生成。
Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation

- 用冻结的通用VAE作为统一接口,直接处理CT数据。
- 重建后肿瘤表面精度提升3.9%,生成质量指标改善2.76%以上。
- 适合需要快速部署、跨设备兼容的医疗图像应用者。
变分自编码器(VAEs)可将高分辨率CT体数据压缩为紧凑的潜在表示,同时保留临床相关结构。然而,从零训练或大量微调特定于CT的VAE需付出巨大计算和工程成本,且在异质扫描仪、成像协议和疾病类型下性能常下降。本文提出一种无训练医疗VAE的新路径:一个在自然图像和视频上大规模预训练的通用VAE,可作为统一接口用于CT重建、增强与生成。在编码器和解码器均冻结的前提下,该通用VAE能重建保留解剖结构并抑制采集噪声的CT体积;基于这些重建结果训练分割模型,胰腺癌和肺癌肿瘤表面精度平均提升3.9% NSD。在同一通用VAE潜在空间中,条件潜空间扩散模型实现3.9%更低的平均FVD,CT CLIP得分提高36.2%,18类疾病的生成保真度提升2.76% AUC。这些结果表明,通用VAE可作为可扩展的CT表征复用与真实感生成的实用接口。代码与演示见https://github.com/qic999/Foundation-VAE。
原文摘要 · Abstract (English)
Variational autoencoders (VAEs) compress high resolution CT volumes into compact latents while preserving clinically relevant structure. However, training CT-specific VAEs from scratch or heavily fine-tuning them incurs substantial computational and engineering cost, and often degrades under heterogeneous scanners, protocols, and diseases. This paper makes a progressive stride toward training-free medical VAEs by leveraging a critical observation: a single Foundation VAE, pretrained at scale on natural images and videos, can serve as a unified interface for CT Reconstruction, Augmentation, and Generation. With both encoder and decoder frozen, the Foundation VAE reconstructs CT volumes with preserved anatomy while suppressing acquisition noise; training segmentation models on these reconstructions improves surface accuracy by 3.9% NSD on average for pancreatic tumor and lung tumor. Within the same Foundation VAE latent space, a conditional latent diffusion model achieves 3.9% lower average FVD with 36.2% higher CT CLIP score, and improves multi-disease generation faithfulness across 18 types by 2.76% AUC. These results demonstrate Foundation VAEs as a practical interface for scalable CT representation reuse and faithful CT generation. Our code and demo are available at https://github.com/qic999/Foundation-VAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。