arXiv:2410.22265cs.CV2024-10被引 4

用生物启发的神经元自动机实现轻量级医学影像配准,速度更快、资源更省。

NCA-Morph: Medical Image Registration with Neural Cellular Automata

  • 基于神经元自动机构建局部通信网络,模拟生物系统交互机制。
  • 在脑、前列腺和海马体影像上达到顶尖性能,参数量比VoxelMorph少60%。
  • 轻量设计适合基层医疗和手术室等资源受限场景使用。

医学图像配准是将不同患者扫描图像对齐的关键步骤,有助于诊断、手术规划和病情追踪。传统优化方法速度慢,深度学习技术如VoxelMorph和基于Transformer的方法虽加快了速度,但资源消耗大。为此,我们提出NCA-Morph,一种融合深度学习与生物启发式通信网络的新方法,利用神经元自动机(NCAs)实现像素间随时间演化的局部通信,模仿活体系统中的交互行为。我们在三个3D配准任务上进行了广泛实验,涵盖健康与患病患者的脑、前列腺和海马体影像。结果表明,NCA-Morph实现了领先性能,且参数量分别比VoxelMorph减少60%,比TransMorph减少99.7%。该特性使其成为资源受限场景(如初级医疗和手术室)的理想解决方案。

原文摘要 · Abstract (English)

Medical image registration is a critical process that aligns various patient scans, facilitating tasks like diagnosis, surgical planning, and tracking. Traditional optimization based methods are slow, prompting the use of Deep Learning (DL) techniques, such as VoxelMorph and Transformer-based strategies, for faster results. However, these DL methods often impose significant resource demands. In response to these challenges, we present NCA-Morph, an innovative approach that seamlessly blends DL with a bio-inspired communication and networking approach, enabled by Neural Cellular Automata (NCAs). NCA-Morph not only harnesses the power of DL for efficient image registration but also builds a network of local communications between cells and respective voxels over time, mimicking the interaction observed in living systems. In our extensive experiments, we subject NCA-Morph to evaluations across three distinct 3D registration tasks, encompassing Brain, Prostate and Hippocampus images from both healthy and diseased patients. The results showcase NCA-Morph's ability to achieve state-of-the-art performance. Notably, NCA-Morph distinguishes itself as a lightweight architecture with significantly fewer parameters; 60% and 99.7% less than VoxelMorph and TransMorph. This characteristic positions NCA-Morph as an ideal solution for resource-constrained medical applications, such as primary care settings and operating rooms.

医学影像图像配准神经自动机轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。