解决跨扫描仪脑影像3D无监督融合难题,提升图像一致性与泛化性。
Efficient and robust 3D blind harmonization for large domain gaps
- 基于边缘到图像的3D修正流,实现无源域数据的图像融合
- 多步移位训练与去幻觉模块,提升3D重建效率与鲁棒性
- 适用于多设备、大域差距场景,适合医学影像跨中心研究
盲和谐化已成为实现磁共振图像尺度不变表示的有前景技术,仅需目标域数据即可完成,无需源域数据。然而现有方法存在三维切片异质性、图像质量中等以及在大域差距下性能有限等问题。为此,我们提出BlindHarmonyDiff,一种新型的盲3D和谐化框架,采用专为和谐化设计的边缘到图像模型。该框架使用目标域图像训练的3D修正流,从边缘图重构原始图像,并利用源域图像的边缘生成和谐化图像。我们提出多步移位块训练以实现高效3D训练,并引入精炼模块抑制幻觉,增强推理鲁棒性。大量实验表明,BlindHarmonyDiff能将多样源域图像和谐化至目标域,在特征对应性上优于先前方法。下游任务评估(如组织分割、年龄预测)在多种磁共振扫描仪上进一步验证了该方法的有效性,证明其具备强鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Blind harmonization has emerged as a promising technique for MR image harmonization to achieve scale-invariant representations, requiring only target domain data (i.e., no source domain data necessary). However, existing methods face limitations such as inter-slice heterogeneity in 3D, moderate image quality, and limited performance for a large domain gap. To address these challenges, we introduce BlindHarmonyDiff, a novel blind 3D harmonization framework that leverages an edge-to-image model tailored specifically to harmonization. Our framework employs a 3D rectified flow trained on target domain images to reconstruct the original image from an edge map, then yielding a harmonized image from the edge of a source domain image. We propose multi-stride patch training for efficient 3D training and a refinement module for robust inference by suppressing hallucination. Extensive experiments demonstrate that BlindHarmonyDiff outperforms prior arts by harmonizing diverse source domain images to the target domain, achieving higher correspondence to the target domain characteristics. Downstream task-based quality assessments such as tissue segmentation and age prediction on diverse MR scanners further confirm the effectiveness of our approach and demonstrate the capability of our robust and generalizable blind harmonization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。