提出多层级相关性平衡优化方法,解决术中多模态医学图像配准难题。
Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization
- 基于模态无关邻域描述符提取特征,实现跨模态映射
- 多层级金字塔融合优化使形变场全局与局部更精确,提升配准效果
- 在两个任务中均获第二,适合医学图像配准研究者参考
基于多模态图像配准的手术导航在术中为外科医生提供目标区域与重要解剖结构相对位置信息方面发挥重要作用。然而,由于多模态图像差异以及术中组织位移和切除导致的图像形变,术前与术中多模态图像的有效配准面临严峻挑战。针对 Learn2Reg 2024 中的多模态图像配准问题,本文设计了一种基于多层级相关性平衡优化(MCBO)的无监督医学图像配准方法。首先,利用模态无关邻域描述符提取各模态特征,并将多模态图像映射至特征空间;其次,设计多层级金字塔融合优化机制,通过密集相关性分析与加权平衡耦合凸优化,在不同尺度输入特征上实现形变场的全局优化与局部细节互补。对于不同模态的术前医学图像,通过形变场间的最大融合实现有效信息对齐与堆叠。本方法聚焦于 Learn2Reg 2024 的 ReMIND2Reg 任务,并进一步在 COMULIS3DCLEM 任务上验证其泛化能力。实验结果表明,该方法在两项任务的验证集上均取得第二名成绩。代码已公开于 https://github.com/wjiazheng/MCBO。
原文摘要 · Abstract (English)
Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structures during surgery. However, due to the differences between multimodal images and intraoperative image deformation caused by tissue displacement and removal during surgery, effective registration of preoperative and intraoperative multimodal images faces significant challenges. To address the multimodal image registration challenges in Learn2Reg 2024, an unsupervised multimodal medical image registration method based on multilevel correlation balanced optimization (MCBO) is designed to solve these problems. First, the features of each modality are extracted based on the modality independent neighborhood descriptor, and the multimodal images are mapped to the feature space. Second, a multilevel pyramidal fusion optimization mechanism is designed to achieve global optimization and local detail complementation of the deformation field through dense correlation analysis and weight-balanced coupled convex optimization for input features at different scales. For preoperative medical images in different modalities, the alignment and stacking of valid information between different modalities is achieved by the maximum fusion between deformation fields. Our method focuses on the ReMIND2Reg task in Learn2Reg 2024, and to verify the generality of the method, we also tested it on the COMULIS3DCLEM task. Based on the results, our method achieved second place in the validation of both two tasks. The code is available at https://github.com/wjiazheng/MCBO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。