arXiv:2411.15426cs.CV2024-11被引 7

用扩散模型提升医学图像配准的语义精度与拓扑保持能力

LDM-Morph: Latent diffusion model guided deformable image registration

  • 引入扩散模型潜空间特征增强配准语义信息
  • 提出分层相似性度量,在像素与潜空间双重优化
  • 适合需高精度与拓扑保真的医学图像配准场景

可变形图像配准在医学影像任务中至关重要。现有基于深度学习的方法多依赖卷积神经网络或Transformer提取特征预测形变,但其特征缺乏语义信息,且损失函数仅在像素空间评估相似性,忽略高层解剖特征匹配,易导致形变折叠。为此,本文提出LDM-Morph,一种无监督的可变形配准方法。该方法融合潜空间扩散模型(LDM)提取的特征以丰富语义信息,并设计基于潜空间与全局特征的交叉注意力模块(LGCA),增强语义与全局信息交互。同时提出分层相似性度量,在原始像素空间与潜空间双重评估图像对相似性,兼顾拓扑保持与配准精度。在四个公开2D心脏图像数据集上的大量实验表明,LDM-Morph在准确性和拓扑保持方面优于现有主流CNN与Transformer基线方法,计算效率相当。代码已开源:https://github.com/wujiong-hub/LDM-Morph。

原文摘要 · Abstract (English)

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features to predict the deformations. However, the lack of semantic information in the learned features limits the registration performance. Furthermore, the similarity metric of the loss function is often evaluated only in the pixel space, which ignores the matching of high-level anatomical features and can lead to deformation folding. To address these issues, in this work, we proposed LDM-Morph, an unsupervised deformable registration algorithm for medical image registration. LDM-Morph integrated features extracted from the latent diffusion model (LDM) to enrich the semantic information. Additionally, a latent and global feature-based cross-attention module (LGCA) was designed to enhance the interaction of semantic information from LDM and global information from multi-head self-attention operations. Finally, a hierarchical metric was proposed to evaluate the similarity of image pairs in both the original pixel space and latent-feature space, enhancing topology preservation while improving registration accuracy. Extensive experiments on four public 2D cardiac image datasets show that the proposed LDM-Morph framework outperformed existing state-of-the-art CNNs- and Transformers-based registration methods regarding accuracy and topology preservation with comparable computational efficiency. Our code is publicly available at https://github.com/wujiong-hub/LDM-Morph.

医学图像可变形配准扩散模型拓扑保持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。