arXiv:2411.06315cs.CVcs.AI2024-11

NeuReg实现跨物种脑影像的高精度配准,突破域差异限制。

NeuReg: Domain-invariant 3D Image Registration on Human and Mouse Brains

  • 基于神经启发的Swin Transformer架构,生成域无关特征表示。
  • 在人鼠多域数据集上超越现有模型,跨域测试性能显著提升。
  • 适合需跨模态、跨物种医学图像配准的研究者使用。

医学脑成像依赖图像配准精确刻画脑结构边界,用于多种医疗应用。近年来深度学习模型在图像配准中表现优异,但仍难以应对3D脑体积的多样性,受结构与对比度差异及成像域影响。本文提出NeuReg,一种具有域不变性的神经启发3D图像配准架构,通过生成域无关的成像特征表示,并采用基于滑动窗口的Swin Transformer块作为编码器,有效捕捉不同脑成像模态与物种间的差异。我们在包含人类与小鼠3D脑影像的公开多域数据集上建立新基准。大量实验表明,NeuReg在源域仅训练、目标域完全未见的跨域数据集上表现优异,显著优于现有深度学习基线模型。本工作基于神经启发的Transformer架构,确立了域无关3D脑图像配准的新范式。

原文摘要 · Abstract (English)

Medical brain imaging relies heavily on image registration to accurately curate structural boundaries of brain features for various healthcare applications. Deep learning models have shown remarkable performance in image registration in recent years. Still, they often struggle to handle the diversity of 3D brain volumes, challenged by their structural and contrastive variations and their imaging domains. In this work, we present NeuReg, a Neuro-inspired 3D image registration architecture with the feature of domain invariance. NeuReg generates domain-agnostic representations of imaging features and incorporates a shifting window-based Swin Transformer block as the encoder. This enables our model to capture the variations across brain imaging modalities and species. We demonstrate a new benchmark in multi-domain publicly available datasets comprising human and mouse 3D brain volumes. Extensive experiments reveal that our model (NeuReg) outperforms the existing baseline deep learning-based image registration models and provides a high-performance boost on cross-domain datasets, where models are trained on 'source-only' domain and tested on completely 'unseen' target domains. Our work establishes a new state-of-the-art for domain-agnostic 3D brain image registration, underpinned by Neuro-inspired Transformer-based architecture.

图像配准3D脑影像域不变Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。