通过三面体结构提升医学影像配准精度。
Tetrahedron-Net for Medical Image Registration
- 设计双解码器三面体结构,增强编码器与解码器间交互。
- 在多个基准上实现更优配准性能,显著提升精度。
- 可无缝集成至U-Net类模型,适用性强。
医学图像配准在医学图像处理中至关重要。提取具有表现力的图像特征对提升配准质量尤为关键。当前主流方法多采用卷积骨干网络,结合跳接连接以促进特征层间的交互。典型架构如U-Net系列,通过嵌套或全尺度跳接连接单个编码器与单个解码器,以增强表示能力。尽管有效,但仍未充分挖掘单编码器-单解码器架构下的交互潜力。本文提出一种简洁而高效的新策略:在原有结构基础上增加一个额外解码器,使其同时与原始编码器和解码器交互。该设计不仅复用编码器对应层的特征表示,还协同原解码器生成更精准的配准结果。新架构仅含一个编码器和两个解码器,形成‘三面体’结构,命名为Tetrahedron-Net。针对附加解码器的不同结构,构建了三种实例。大量实验表明,Tetrahedron-Net在多个代表性医学图像配准基准上均取得优越性能。此外,该‘三面体’设计可轻松集成至VoxelMorph、ViT-V-Net和TransMorph等主流U-Net类模型,带来一致的性能提升。
原文摘要 · Abstract (English)
Medical image registration plays a vital role in medical image processing. Extracting expressive representations for medical images is crucial for improving the registration quality. One common practice for this end is constructing a convolutional backbone to enable interactions with skip connections among feature extraction layers. The de facto structure, U-Net-like networks, has attempted to design skip connections such as nested or full-scale ones to connect one single encoder and one single decoder to improve its representation capacity. Despite being effective, it still does not fully explore interactions with a single encoder and decoder architectures. In this paper, we embrace this observation and introduce a simple yet effective alternative strategy to enhance the representations for registrations by appending one additional decoder. The new decoder is designed to interact with both the original encoder and decoder. In this way, it not only reuses feature presentation from corresponding layers in the encoder but also interacts with the original decoder to corporately give more accurate registration results. The new architecture is concise yet generalized, with only one encoder and two decoders forming a ``Tetrahedron'' structure, thereby dubbed Tetrahedron-Net. Three instantiations of Tetrahedron-Net are further constructed regarding the different structures of the appended decoder. Our extensive experiments prove that superior performance can be obtained on several representative benchmarks of medical image registration. Finally, such a ``Tetrahedron'' design can also be easily integrated into popular U-Net-like architectures including VoxelMorph, ViT-V-Net, and TransMorph, leading to consistent performance gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。