用结构引导微调扩散模型,高效生成可控医学图像。
MedDiff-FT: Data-Efficient Diffusion Model Fine-tuning with Structural Guidance for Controllable Medical Image Synthesis
- 通过动态自适应掩码约束解剖结构,实现可控生成。
- 在5个数据集上使分割性能平均提升1%(Dice score)。
- 适合医疗数据稀缺场景下的图像增强与模型训练。
深度学习在医学图像分割中的进展常受限于高质量训练数据的匮乏。虽然扩散模型可通过生成合成图像提供解决方案,但其在医学影像中的应用仍受制于对大规模医学数据集的依赖及对更高图像质量的要求。为此,我们提出MedDiff-FT,一种可控制的医学图像生成方法,通过数据高效微调扩散基础模型,生成具有结构依赖性和领域特异性的医学图像。推理时,动态自适应引导掩码施加空间约束以确保解剖一致性,轻量级随机掩码生成器通过分层随机注入增强多样性。此外,采用基于特征空间度量的自动质量评估协议筛选劣质输出,并通过掩码腐蚀提升保真度。在五个医学分割数据集上的评估显示,MedDiff-FT生成的图像-掩码对使SOTA方法的分割性能平均提升1%(Dice score)。该框架在生成质量、多样性和计算效率间取得良好平衡,为医学数据增强提供了实用方案。代码已开源:https://github.com/JianhaoXie1/MedDiff-FT。
原文摘要 · Abstract (English)
Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in medical imaging remains constrained due to their reliance on large-scale medical datasets and the need for higher image quality. To address these challenges, we present MedDiff-FT, a controllable medical image generation method that fine-tunes a diffusion foundation model to produce medical images with structural dependency and domain specificity in a data-efficient manner. During inference, a dynamic adaptive guiding mask enforces spatial constraints to ensure anatomically coherent synthesis, while a lightweight stochastic mask generator enhances diversity through hierarchical randomness injection. Additionally, an automated quality assessment protocol filters suboptimal outputs using feature-space metrics, followed by mask corrosion to refine fidelity. Evaluated on five medical segmentation datasets,MedDiff-FT's synthetic image-mask pairs improve SOTA method's segmentation performance by an average of 1% in Dice score. The framework effectively balances generation quality, diversity, and computational efficiency, offering a practical solution for medical data augmentation. The code is available at https://github.com/JianhaoXie1/MedDiff-FT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。