用深度学习加速生物力学图像配准,5分钟达成高精度结果
Multi-Objective Deep-Learning-based Biomechanical Deformable Image Registration with MOREA
- 用DL预测初值,智能初始化进化算法优化生物力学模型
- 5分钟内完成配准,折叠少、膀胱轮廓误差更小
- 适合大形变配准,兼顾速度与物理真实性,临床实用性强
在处理大形变和内容不匹配的图像时,传统可变形图像配准(DIR)方法常需在变换真实性和计算时间间权衡。基于深度学习(DL)的方法能快速预测变换,但在复杂问题上真实性不足;而基于生物力学有限元建模(FEM)的方法虽更真实,但耗时长。本文提出首个混合方法DL-MOREA,结合基于VoxelMorph框架的多目标DL-DIR方法DL-MODIR与基于进化算法的多目标DIR方法MOREA(采用类FEM网格变换模型)。该方法以DL结果智能初始化MOREA,提升网格模型优化效率。在15名宫颈癌患者的大膀胱充盈差异CT扫描对上评估,相较需45分钟的MOREA,DL-MOREA仅用5分钟即获得高质量配准结果。相比DL-MODIR,DL-MOREA生成的变换折叠更少,膀胱轮廓距离误差显著改善或保持不变。
原文摘要 · Abstract (English)
When choosing a deformable image registration (DIR) approach for images with large deformations and content mismatch, the realism of found transformations often needs to be traded off against the required runtime. DIR approaches using deep learning (DL) techniques have shown remarkable promise in instantly predicting a transformation. However, on difficult registration problems, the realism of these transformations can fall short. DIR approaches using biomechanical, finite element modeling (FEM) techniques can find more realistic transformations, but tend to require much longer runtimes. This work proposes the first hybrid approach to combine them, with the aim of getting the best of both worlds. This hybrid approach, called DL-MOREA, combines a recently introduced multi-objective DL-based DIR approach which leverages the VoxelMorph framework, called DL-MODIR, with MOREA, an evolutionary algorithm-based, multi-objective DIR approach in which a FEM-like biomechanical mesh transformation model is used. In our proposed hybrid approach, the DL results are used to smartly initialize MOREA, with the aim of more efficiently optimizing its mesh transformation model. We empirically compare DL-MOREA against its components, DL-MODIR and MOREA, on CT scan pairs capturing large bladder filling differences of 15 cervical cancer patients. While MOREA requires a median runtime of 45 minutes, DL-MOREA can already find high-quality transformations after 5 minutes. Compared to the DL-MODIR transformations, the transformations found by DL-MOREA exhibit far less folding and improve or preserve the bladder contour distance error.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。