arXiv:2508.12445eess.IVcs.CV2025-08被引 4

用分数傅里叶变换提升医学图像变形配准精度,兼顾局部与全局形变建模。

FractMorph: A Fractional Fourier-Based Multi-Domain Transformer for Deformable Image Registration

  • 引入多域分数傅里叶注意力,同步捕捉局部、半全局与全局特征
  • 在心脏MRI数据上达86.45%的骰子系数,HD95仅1.54mm
  • 轻量模型仅29.6M参数,适合临床部署且无需特定场景调优

可变形图像配准(DIR)是医学影像中对齐解剖结构的关键技术,广泛应用于临床。现有方法难以在同一框架内同时捕捉精细局部形变与大尺度全局形变。本文提出FractMorph,一种基于3D双并行变压器的新型架构,通过多域分数傅里叶变换(FrFT)分支增强跨图像特征匹配。每个分数交叉注意力(FCA)块在0°、45°、90°分数量角及对数幅值分支上并行执行FrFT,同步提取局部、半全局与全局特征,并通过固定图与移动图流间的交叉注意力融合。随后,轻量级U-Net风格网络从增强特征中预测稠密形变场。在患者内心脏MRI数据集ACDC上,FractMorph取得86.45%的总体骰子相似系数(DSC)、75.15%的平均结构DSC和1.54 mm的95百分位豪斯多夫距离(HD95)。FractMorph-Light版本仅含29.6M参数,模型复杂度减半,仍保持高精度。此外,在脑图谱到患者数据集上也表现出色。结果表明,变压器中的多域频-空注意力可高效建模复杂非刚性形变,无需分层多尺度网络或场景特异性调参。源码已开源。

原文摘要 · Abstract (English)

Deformable image registration (DIR) is a crucial and challenging technique for aligning anatomical structures in medical images and is widely applied in diverse clinical applications. However, existing approaches often struggle to capture fine-grained local deformations and large-scale global deformations simultaneously within a unified framework. We present FractMorph, a novel 3D dual-parallel transformer-based architecture that enhances cross-image feature matching through multi-domain fractional Fourier transform (FrFT) branches. Each Fractional Cross-Attention (FCA) block applies parallel FrFTs at fractional angles of $0^\circ$, $45^\circ$, $90^\circ$, along with a log-magnitude branch, to effectively extract local, semi-global, and global features at the same time. These features are fused via cross-attention between the fixed and moving image streams. A lightweight U-Net style network then predicts a dense deformation field from the transformer-enriched features. On the intra-patient ACDC cardiac MRI dataset, FractMorph achieves state-of-the-art performance with an overall Dice Similarity Coefficient (DSC) of $86.45\%$, an average per-structure DSC of $75.15\%$, and a 95th-percentile Hausdorff distance (HD95) of $1.54~\mathrm{mm}$ on our data split. FractMorph-Light, a lightweight variant of our model with only 29.6M parameters, preserves high accuracy while halving model complexity. Furthermore, we demonstrate the generality of our approach with solid performance on a cerebral atlas-to-patient dataset. Our results demonstrate that multi-domain spectral-spatial attention in transformers can robustly and efficiently model complex non-rigid deformations in medical images using a single end-to-end network, without the need for scenario-specific tuning or hierarchical multi-scale networks. The source code is available at https://github.com/shayankebriti/FractMorph.

医学图像变形配准注意力机制傅里叶变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。