用注意力机制提升医学影像非刚性配准精度与合理性。
Attention-Driven Framework for Non-Rigid Medical Image Registration
- 引入多尺度双向注意力,精准建立图像间对应关系。
- 在脑部和胸部数据集上均达顶尖性能,误差低于现有方法。
- 适合临床部署,兼顾精度与计算效率。
非刚性医学图像配准是疾病诊断、治疗规划和图像引导手术中的基础任务。尽管基于深度学习的方法取得了显著进展,但在大形变情况下实现精确配准并保持解剖合理性仍是挑战。本文提出一种新型注意力驱动的非刚性医学图像配准框架(AD-RegNet),结合3D UNet主干网络与双向交叉注意力机制,在多尺度下建立移动图像与固定图像之间的对应关系。引入区域自适应注意力机制,聚焦解剖相关结构,并采用多分辨率形变场合成方法以实现精准对齐。该方法在两个不同数据集上进行评估:用于胸腔4D CT扫描的DIRLab和用于脑部MRI扫描的IXI,展示了跨解剖结构与成像模态的泛化能力。实验结果表明,该方法在IXI和DIRLab数据集上性能优于或相当主流方法。所提方法在配准精度与计算效率之间取得良好平衡,适用于临床应用。综合使用归一化互相关(NCC)、均方误差(MSE)、结构相似性(SSIM)、雅可比行列式及目标配准误差(TRE)的评估显示,注意力引导的配准提升了对齐精度,同时保证了解剖合理性。
原文摘要 · Abstract (English)
Deformable medical image registration is a fundamental task in medical image analysis with applications in disease diagnosis, treatment planning, and image-guided interventions. Despite significant advances in deep learning based registration methods, accurately aligning images with large deformations while preserving anatomical plausibility remains a challenging task. In this paper, we propose a novel Attention-Driven Framework for Non-Rigid Medical Image Registration (AD-RegNet) that employs attention mechanisms to guide the registration process. Our approach combines a 3D UNet backbone with bidirectional cross-attention, which establishes correspondences between moving and fixed images at multiple scales. We introduce a regional adaptive attention mechanism that focuses on anatomically relevant structures, along with a multi-resolution deformation field synthesis approach for accurate alignment. The method is evaluated on two distinct datasets: DIRLab for thoracic 4D CT scans and IXI for brain MRI scans, demonstrating its versatility across different anatomical structures and imaging modalities. Experimental results demonstrate that our approach achieves performance competitive with state-of-the-art methods on the IXI and DIRLab datasets. The proposed method maintains a favorable balance between registration accuracy and computational efficiency, making it suitable for clinical applications. A comprehensive evaluation using normalized cross-correlation (NCC), mean squared error (MSE), structural similarity (SSIM), Jacobian determinant, and target registration error (TRE) indicates that attention-guided registration improves alignment accuracy while ensuring anatomically plausible deformations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。