用扩散模型双向修复和生成多发性硬化脑部病灶,提升影像分析与分割性能。
MSRepaint: Multiple Sclerosis Repaint with Conditional Denoising Diffusion Implicit Model for Bidirectional Lesion Filling and Synthesis
- 基于条件去噪扩散模型,通过病灶掩码实现体素级精准控制。
- 修复病灶后下游任务准确率媲美先进方法,推理速度提升20倍以上。
- 可生成逼真病灶数据,支持病灶演化模拟,适合医学影像研究者使用。
多发性硬化病灶干扰脑部磁共振影像的自动分析(如脑区分割和非刚性配准),而病灶分割模型又受限于标注数据稀缺。为此,我们提出MSRepaint——一种统一的基于扩散的生成模型,实现病灶双向填充与合成,恢复解剖连续性并生成真实数据增强分割训练。该模型以空间病灶掩码为条件,实现体素级控制;引入对比度丢失机制应对输入缺失;集成重绘机制保留周围解剖结构;采用多视角DDIM反演融合流程保证3D一致性并实现快速推理。大量评估表明:在病灶填充方面,其填充区域精度优于传统方法FSL与NiftySeg,与近期基于扩散模型的FastSurfer-LIT相当,且推理速度超20倍;在病灶合成方面,基于MSRepaint生成数据训练的先进分割模型,在MICCAI 2016与UMCL等多个基准上表现超越使用CarveMix数据或真实ISBI挑战数据训练的模型。此外,其具备完整空间控制的双向能力,可高保真模拟纵向病灶演化过程。
原文摘要 · Abstract (English)
In multiple sclerosis, lesions interfere with automated magnetic resonance imaging analyses such as brain parcellation and deformable registration, while lesion segmentation models are hindered by the limited availability of annotated training data. To address both issues, we propose MSRepaint, a unified diffusion-based generative model for bidirectional lesion filling and synthesis that restores anatomical continuity for downstream analyses and augments segmentation through realistic data generation. MSRepaint conditions on spatial lesion masks for voxel-level control, incorporates contrast dropout to handle missing inputs, integrates a repainting mechanism to preserve surrounding anatomy during lesion filling and synthesis, and employs a multi-view DDIM inversion and fusion pipeline for 3D consistency with fast inference. Extensive evaluations demonstrate the effectiveness of MSRepaint across multiple tasks. For lesion filling, we evaluate both the accuracy within the filled regions and the impact on downstream tasks including brain parcellation and deformable registration. MSRepaint outperforms the traditional lesion filling methods FSL and NiftySeg, and achieves accuracy on par with FastSurfer-LIT, a recent diffusion model-based inpainting method, while offering over 20 times faster inference. For lesion synthesis, state-of-the-art MS lesion segmentation models trained on MSRepaint-synthesized data outperform those trained on CarveMix-synthesized data or real ISBI challenge training data across multiple benchmarks, including the MICCAI 2016 and UMCL datasets. Additionally, we demonstrate that MSRepaint's unified bidirectional filling and synthesis capability, with full spatial control over lesion appearance, enables high-fidelity simulation of lesion evolution in longitudinal MS progression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。