arXiv:2506.00591eess.IVcs.CV2025-06

用扩散模型实现无追踪的前列腺多模态图像配准,精度更高且无需额外设备。

MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models

  • 通过视角相关性重建3D超声,无需外部探头定位
  • 双模态映射至伪中间模态,仅保留配准关键特征
  • 结合解剖一致性策略,适合临床精准诊断场景

前列腺癌诊断日益依赖多模态成像,尤其是磁共振成像(MRI)与经直肠超声(TRUS)。然而,由于维度和解剖表达差异,两者间精确配准仍是核心挑战。本文提出一种两阶段新框架:先进行无探头追踪信息的3D TRUS重建,利用矢状面与横断面超声视图间的自然相关性,结合基于聚类的特征匹配方法实现2D帧的空间定位;再通过无监督扩散框架实现跨模态配准,将MRI与超声共同映射到一个伪中间模态,仅保留注册所需特征,显著降低配准难度。为进一步提升解剖对齐效果,引入解剖感知策略,优先保证内部结构一致性,自适应抑制边界不一致影响。大量实验表明,该方法在完全无监督条件下实现了优于现有最优方法的配准精度,并生成物理上合理的形变。

原文摘要 · Abstract (English)

The diagnosis of prostate cancer increasingly depends on multimodal imaging, particularly magnetic resonance imaging (MRI) and transrectal ultrasound (TRUS). However, accurate registration between these modalities remains a fundamental challenge due to the differences in dimensionality and anatomical representations. In this work, we present a novel framework that addresses these challenges through a two-stage process: TRUS 3D reconstruction followed by cross-modal registration. Unlike existing TRUS 3D reconstruction methods that rely heavily on external probe tracking information, we propose a totally probe-location-independent approach that leverages the natural correlation between sagittal and transverse TRUS views. With the help of our clustering-based feature matching method, we enable the spatial localization of 2D frames without any additional probe tracking information. For the registration stage, we introduce an unsupervised diffusion-based framework guided by modality translation. Unlike existing methods that translate one modality into another, we map both MR and US into a pseudo intermediate modality. This design enables us to customize it to retain only registration-critical features, greatly easing registration. To further enhance anatomical alignment, we incorporate an anatomy-aware registration strategy that prioritizes internal structural coherence while adaptively reducing the influence of boundary inconsistencies. Extensive validation demonstrates that our approach outperforms state-of-the-art methods by achieving superior registration accuracy with physically realistic deformations in a completely unsupervised fashion.

医学图像图像配准扩散模型前列腺

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。