用改进的优化方法提升医学影像配准模型的泛化能力。
Improving Generalization of Medical Image Registration Foundation Model
- 引入尖锐感知优化,让模型在复杂数据分布下更稳定。
- 在跨数据集测试中显著提升配准准确率,最高提升12.3%。
- 适合需要高鲁棒性的临床影像分析场景使用。
可变形配准是医学图像处理中的基础任务,旨在通过建立非线性对应关系实现图像精准对齐。传统方法具有良好的适应性和可解释性,但计算效率受限;深度学习方法虽显著提升了配准速度与精度,却常缺乏跨数据集和任务的灵活性与泛化能力。近年来,基础模型通过利用大规模多样数据学习通用特征与变换模式,在跨任务迁移方面展现出强潜力。然而,面对新解剖结构、成像条件差异或未见模态时,其泛化性和鲁棒性仍面临挑战。为此,本文将尖锐感知最小化(Sharpness-Aware Minimization, SAM)引入基础模型,通过优化损失曲面的平坦性,增强模型在不同数据分布下的稳定性,提升其应对复杂临床场景的能力。实验表明,集成SAM的基础模型在跨数据集配准性能上取得显著提升,为医学图像配准技术的发展提供了新思路。代码已开源:https://github.com/Promise13/fm_sam。
原文摘要 · Abstract (English)
Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but are limited by computational efficiency. Although deep learning approaches have significantly improved registration speed and accuracy, they often lack flexibility and generalizability across different datasets and tasks. In recent years, foundation models have emerged as a promising direction, leveraging large and diverse datasets to learn universal features and transformation patterns for image registration, thus demonstrating strong cross-task transferability. However, these models still face challenges in generalization and robustness when encountering novel anatomical structures, varying imaging conditions, or unseen modalities. To address these limitations, this paper incorporates Sharpness-Aware Minimization (SAM) into foundation models to enhance their generalization and robustness in medical image registration. By optimizing the flatness of the loss landscape, SAM improves model stability across diverse data distributions and strengthens its ability to handle complex clinical scenarios. Experimental results show that foundation models integrated with SAM achieve significant improvements in cross-dataset registration performance, offering new insights for the advancement of medical image registration technology. Our code is available at https://github.com/Promise13/fm_sam}{https://github.com/Promise13/fm\_sam.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。