MedLoRD用24GB显存生成高分辨率3D CT图像,适合资源有限的医院使用。
MedLoRD: A Medical Low-Resource Diffusion Model for High-Resolution 3D CT Image Synthesis
- 基于扩散模型,在低资源环境下生成512×512×256分辨率3D CT图像
- 在冠脉和肺部CT数据集上生成图像质量高,符合分割掩码约束
- 通过放射科医生评估和下游任务验证,优于现有同类模型
人工智能在医学影像中的进展潜力巨大,但受限于数据稀缺及医疗机构因患者隐私不愿共享数据。生成模型可通过合成数据替代真实数据,成为可行方案。然而,医学图像维度高,现有先进方法通常对计算资源要求过高,在资源受限的医疗环境中不实用,且常依赖数据子采样,影响可实施性。此外,多数模型仅依赖量化指标评估,难以反映图像质量与临床意义。为此,我们提出MedLoRD,一种专为低资源环境设计的生成扩散模型。该模型可在仅24GB显存的普通桌面工作站GPU上,生成最高达512×512×256分辨率的高维医学体积图像。在冠状动脉计算机断层血管造影(CCTA)和肺部计算机断层扫描(Lung CT)等多个模态数据集上进行评估。通过放射科医生评审、相对区域体积分析、条件掩码一致性以及下游任务等多维度验证,结果表明MedLoRD生成的图像保真度高,严格遵循分割掩码条件,显著优于当前资源受限环境下的主流生成模型。
原文摘要 · Abstract (English)
Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns. Generative models present a promising solution by creating synthetic data as a substitute for real patient data. However, medical images are typically high-dimensional, and current state-of-the-art methods are often impractical for computational resource-constrained healthcare environments. These models rely on data sub-sampling, raising doubts about their feasibility and real-world applicability. Furthermore, many of these models are evaluated on quantitative metrics that alone can be misleading in assessing the image quality and clinical meaningfulness of the generated images. To address this, we introduce MedLoRD, a generative diffusion model designed for computational resource-constrained environments. MedLoRD is capable of generating high-dimensional medical volumes with resolutions up to 512$\times$512$\times$256, utilizing GPUs with only 24GB VRAM, which are commonly found in standard desktop workstations. MedLoRD is evaluated across multiple modalities, including Coronary Computed Tomography Angiography and Lung Computed Tomography datasets. Extensive evaluations through radiological evaluation, relative regional volume analysis, adherence to conditional masks, and downstream tasks show that MedLoRD generates high-fidelity images closely adhering to segmentation mask conditions, surpassing the capabilities of current state-of-the-art generative models for medical image synthesis in computational resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。