解决医学影像跨模态配准难题,提升异质影像对齐精度。
Mono-Modalizing Extremely Heterogeneous Multi-Modal Medical Image Registration
- 用单模态相似性训练多模态配准模型,避免传统方法失效。
- 在ADNI数据集上,配准效果提升2倍,分割重叠度达新高。
- 无需标注或分割掩码,适合真实临床场景使用。
临床中,功能类影像(如PET、FA)常需与结构影像(如MRI、CT)配准以进行准确解读或群体分析,这依赖于多模态可变形图像配准(DIR)。然而,由于这些模态与标准结构扫描存在极端异质性,传统无监督DIR方法难以学习可靠的空间映射,常导致图像扭曲。我们发现,引导模型的相似性度量无法捕捉高度差异模态间的对齐关系。为此,提出M2M-Reg(Multi-to-Mono Registration)框架,仅使用单模态相似性训练多模态DIR模型,同时保持原有架构,便于无缝集成。引入GradCyCon正则化器,利用循环训练机制促进微分同胚性。该框架还可自然扩展至半监督设置,仅需预配准和未配准图像对,无需真实变换或分割掩码。在阿尔茨海默病神经影像计划(ADNI)数据集上的实验表明,M2M-Reg在PET-MRI与FA-MRI配准中,分割重叠度(DSC)较之前方法最高提升2倍,证明其在处理高度异质多模态配准中的有效性。代码已开源。
原文摘要 · Abstract (English)
In clinical practice, imaging modalities with functional characteristics, such as positron emission tomography (PET) and fractional anisotropy (FA), are often aligned with a structural reference (e.g., MRI, CT) for accurate interpretation or group analysis, necessitating multi-modal deformable image registration (DIR). However, due to the extreme heterogeneity of these modalities compared to standard structural scans, conventional unsupervised DIR methods struggle to learn reliable spatial mappings and often distort images. We find that the similarity metrics guiding these models fail to capture alignment between highly disparate modalities. To address this, we propose M2M-Reg (Multi-to-Mono Registration), a novel framework that trains multi-modal DIR models using only mono-modal similarity while preserving the established architectural paradigm for seamless integration into existing models. We also introduce GradCyCon, a regularizer that leverages M2M-Reg's cyclic training scheme to promote diffeomorphism. Furthermore, our framework naturally extends to a semi-supervised setting, integrating pre-aligned and unaligned pairs only, without requiring ground-truth transformations or segmentation masks. Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that M2M-Reg achieves up to 2x higher DSC than prior methods for PET-MRI and FA-MRI registration, highlighting its effectiveness in handling highly heterogeneous multi-modal DIR. Our code is available at https://github.com/MICV-yonsei/M2M-Reg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。