用深度平衡模型让医学图像配准更稳定高效,内存占用不变。
Bridging Classical and Learning-based Iterative Registration through Deep Equilibrium Models
- 将配准建模为寻找平衡点,避免传统迭代的不稳定性。
- 在脑部MRI和肺部CT上性能接近顶尖方法,内存消耗大幅降低。
- 适合追求高稳定性和低显存需求的医学影像研究者。
可变形医学图像配准传统上被表述为优化问题。经典方法通过迭代求解,而近年学习型方法使用循环神经网络(RNN)以固定步数展开预测形变场。然而,经典方法通常能收敛,学习型展开方法缺乏理论收敛保证且实测中不稳定。此外,展开方法训练时存在实际瓶颈:由于时间反向传播(BPTT),GPU内存随展开步数线性增长。为解决理论与实践双重挑战,我们提出基于深度平衡模型(DEQ)的DEQReg框架,将配准建模为寻求平衡点的问题,自然连接经典优化与现代学习型展开方法。DEQReg保持恒定内存消耗,支持理论上无限迭代步数。在公开的脑部MRI与肺部CT数据集上广泛评估表明,DEQReg可实现竞争力配准性能,同时显著降低内存消耗。我们还揭示一个有趣现象:现有展开方法在推理步数超过训练配置后,性能先微升后不可逆下降。而DEQReg凭借内置平衡寻找机制,实现稳定收敛,弥合了经典优化与现代学习型配准方法之间的差距。
原文摘要 · Abstract (English)
Deformable medical image registration is traditionally formulated as an optimization problem. While classical methods solve this problem iteratively, recent learning-based approaches use recurrent neural networks (RNNs) to mimic this process by unrolling the prediction of deformation fields in a fixed number of steps. However, classical methods typically converge after sufficient iterations, but learning-based unrolling methods lack a theoretical convergence guarantee and show instability empirically. In addition, unrolling methods have a practical bottleneck at training time: GPU memory usage grows linearly with the unrolling steps due to backpropagation through time (BPTT). To address both theoretical and practical challenges, we propose DEQReg, a novel registration framework based on Deep Equilibrium Models (DEQ), which formulates registration as an equilibrium-seeking problem, establishing a natural connection between classical optimization and learning-based unrolling methods. DEQReg maintains constant memory usage, enabling theoretically unlimited iteration steps. Through extensive evaluation on the public brain MRI and lung CT datasets, we show that DEQReg can achieve competitive registration performance, while substantially reducing memory consumption compared to state-of-the-art unrolling methods. We also reveal an intriguing phenomenon: the performance of existing unrolling methods first increases slightly then degrades irreversibly when the inference steps go beyond the training configuration. In contrast, DEQReg achieves stable convergence with its inbuilt equilibrium-seeking mechanism, bridging the gap between classical optimization-based and modern learning-based registration methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。