提出非迭代多模态图像配准新方法,解决共享特征泄漏与混合形变难题。
Disentangle-then-Align: Non-Iterative Hybrid Multimodal Image Registration via Cross-Scale Feature Disentanglement
- 通过跨尺度解耦与自适应投影,分离共享特征与模态私有信息。
- 在四个数据集上实现刚性与非刚性配准的领先性能,精度显著提升。
- 适合医学图像分析、跨模态配准等需要高精度对齐的研究者使用。
多模态图像配准是下游跨模态分析的基础任务。尽管共享特征提取和多尺度架构取得进展,仍存在两大局限:其一,部分方法虽采用解耦学习共享特征,但仅正则化共享部分,导致模态私有信息渗入共享空间;其二,多数多尺度框架仅支持单一变换类型,难以应对全局错位与局部形变共存的情况。为此,本文将混合多模态配准建模为联合学习稳定共享特征空间与统一混合变换。基于此,提出HRNet:一种将表示解耦与混合参数预测耦合的注册网络。共享主干结合模态特异性批归一化(MSBN)提取多尺度特征,交叉尺度解耦与自适应投影(CDAP)模块抑制模态私有线索,并将共享特征投影至稳定子空间以供匹配。在此共享空间基础上,混合参数预测模块(HPPM)实现非迭代式粗到精的全局刚性参数与形变场估计,并融合为一致形变场。在四个多模态数据集上的大量实验表明,该方法在刚性与非刚性配准任务中均达到当前最优性能。代码已公开于项目网站。
原文摘要 · Abstract (English)
Multimodal image registration is a fundamental task and a prerequisite for downstream cross-modal analysis. Despite recent progress in shared feature extraction and multi-scale architectures, two key limitations remain. First, some methods use disentanglement to learn shared features but mainly regularize the shared part, allowing modality-private cues to leak into the shared space. Second, most multi-scale frameworks support only a single transformation type, limiting their applicability when global misalignment and local deformation coexist. To address these issues, we formulate hybrid multimodal registration as jointly learning a stable shared feature space and a unified hybrid transformation. Based on this view, we propose HRNet, a Hybrid Registration Network that couples representation disentanglement with hybrid parameter prediction. A shared backbone with Modality-Specific Batch Normalization (MSBN) extracts multi-scale features, while a Cross-scale Disentanglement and Adaptive Projection (CDAP) module suppresses modality-private cues and projects shared features into a stable subspace for matching. Built on this shared space, a Hybrid Parameter Prediction Module (HPPM) performs non-iterative coarse-to-fine estimation of global rigid parameters and deformation fields, which are fused into a coherent deformation field. Extensive experiments on four multimodal datasets demonstrate state-of-the-art performance on rigid and non-rigid registration tasks. The code is available at the project website.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。