用扩散模型扩展胸部CT视野,让肺病研究看到肝肾等周边器官。
Beyond the Lungs: Extending the Field of View in Chest CT with Latent Diffusion Models
- 先用VAE编码切片,再用潜空间扩散模型生成新切片。
- 在NLST数据上成功补全肝脏和肾脏区域,生成切片SSIM达0.81。
- 适合关注肺部疾病全身影响的临床与影像研究者。
肺与其他器官(如肝、肾)的关联对理解肺病风险和改善患者护理至关重要。然而,多数胸部CT研究仅聚焦肺部,受限于成本与辐射剂量,图像视野(FOV)狭窄,难以全面分析肺病对其他器官的影响。为此,我们提出SCOPE(基于先验编码的空间覆盖优化),通过训练变分自编码器(VAE)逐切片编码2D轴向CT图像,将潜变量堆叠为3D上下文,再训练潜空间扩散模型。模型可零样本方式在z方向生成新切片,扩展原始图像视野。在国家肺癌筛查试验(NLST)数据集上的评估显示,该方法有效覆盖原数据未完整包含的肝脏和肾脏区域。在保留的全身体数据集上,生成切片与真实数据的结构相似性(SSIM)达0.81,表明生成结果具有高保真度。
原文摘要 · Abstract (English)
The interconnection between the human lungs and other organs, such as the liver and kidneys, is crucial for understanding the underlying risks and effects of lung diseases and improving patient care. However, most research chest CT imaging is focused solely on the lungs due to considerations of cost and radiation dose. This restricted field of view (FOV) in the acquired images poses challenges to comprehensive analysis and hinders the ability to gain insights into the impact of lung diseases on other organs. To address this, we propose SCOPE (Spatial Coverage Optimization with Prior Encoding), a novel approach to capture the inter-organ relationships from CT images and extend the FOV of chest CT images. Our approach first trains a variational autoencoder (VAE) to encode 2D axial CT slices individually, then stacks the latent representations of the VAE to form a 3D context for training a latent diffusion model. Once trained, our approach extends the FOV of CT images in the z-direction by generating new axial slices in a zero-shot manner. We evaluated our approach on the National Lung Screening Trial (NLST) dataset, and results suggest that it effectively extends the FOV to include the liver and kidneys, which are not completely covered in the original NLST data acquisition. Quantitative results on a held-out whole-body dataset demonstrate that the generated slices exhibit high fidelity with acquired data, achieving an SSIM of 0.81.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。