arXiv:2512.22689cs.CVcs.LG2025-12

用神经微分方程实现多模态医学图像高精度配准,无需大量训练数据。

Multimodal Diffeomorphic Registration with Neural ODEs and Structural Descriptors

  • 基于神经微分方程与结构描述符构建连续深度配准模型
  • 在多模态配准中优于现有方法,对大/小形变均有效
  • 无需训练即可适应新模态,计算高效且鲁棒性强

本文提出一种基于神经常微分方程(Neural ODEs)的多模态微分同胚配准方法。传统非刚性配准在精度、变形模型复杂度和正则化之间存在权衡,且通常假设图像间强度相关性,限制了其在多模态场景的应用。所提方法为实例特定框架,无需大量训练扫描数据,且在未见模态上推理时性能不下降。通过结合神经微分方程的连续深度特性与广泛用于建模模态无关度量的结构描述符,利用参数化邻域几何中的自相似性,设计了三种变体:融合图像级或特征级结构描述符,以及基于局部互信息计算的非结构相似性。在多种扫描数据组合的实验中,本方法在定性和定量指标上均超越当前最优基线,适用于大、小形变场景,尤其擅长多模态配准。此外,验证了该框架在不同正则化水平下仍保持低误差,适合跨尺度配准,并在大形变注册任务中具备更高效率。

原文摘要 · Abstract (English)

This work proposes a multimodal diffeomorphic registration method using Neural Ordinary Differential Equations (Neural ODEs). Nonrigid registration algorithms exhibit tradeoffs between their accuracy, the computational complexity of their deformation model, and its proper regularization. In addition, they also assume intensity correlation in anatomically homologous regions of interest among image pairs, limiting their applicability to the monomodal setting. Unlike learning-based models, we propose an instance-specific framework that is not subject to high scan requirements for training and does not suffer performance degradation at inference time on modalities unseen during training. Our method exploits the potential of continuous-depth networks in the Neural ODE paradigm with structural descriptors, widely adopted as modality-agnostic metric models which exploit self-similarities on parameterized neighborhood geometries. We propose three different variants that integrate image-based or feature-based structural descriptors and nonstructural image similarities computed by local mutual information. We conduct extensive evaluations on different experiments formed by scan dataset combinations and show surpassing qualitative and quantitative results compared to state-of-the-art baselines adequate for large or small deformations, and specific of multimodal registration. Lastly, we also demonstrate the underlying robustness of the proposed framework to varying levels of explicit regularization while maintaining low error, its suitability for registration at varying scales, and its efficiency with respect to other methods targeted to large-deformation registration.

医学图像多模态配准神经ODE结构描述符

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。