arXiv:2605.03490cs.CV2026-05

通过视角感知的无监督域适应提升多模态MRI脑肿瘤分类性能

Orientation-Aware Unsupervised Domain Adaptation for Brain Tumor Classification Across Multi-Modal MRI

论文配图:Orientation-Aware Unsupervised Domain Adaptation for Brain Tumor Classification Across Multi-Modal MRI
图 1 · 摘自论文原文
  • 按影像视角(轴向、矢状、冠状)分组处理,增强特征判别性
  • 在无标注目标域上实现比现有方法高7.2%的分类准确率
  • 适合缺乏标注数据且跨机构影像差异大的医学图像分析场景

深度学习在神经肿瘤学中用于脑肿瘤诊断的临床应用受限于专家标注的MRI数据稀缺,以及因扫描仪、成像协议和对比设置差异导致的机构间域偏移。为应对这一挑战,本文提出一种面向多模态MRI的视角感知无监督域适应框架,用于自动脑肿瘤分类。首先,采用感受野较大的CNN将输入切片分类为轴向、矢状和冠状视角。针对每种视角,使用基于ResNet50骨干网络并附加四个全连接层的CNN提取判别性特征。为缓解标注稀缺与域差异问题,引入切片级无监督域适应策略,将多模态源域(如T1、T2、FLAIR)的知识迁移至增强后对比的T1目标域。通过最大均值差异损失进行特征级对齐,并结合伪标签引导的自适应以保持类别可区分性。大量实验表明,该方法在目标域上的表现优于先前方法,验证了视角特异性学习、多模态知识迁移、伪标签引导适应及无监督域适应的有效性。

原文摘要 · Abstract (English)

The clinical integration of deep learning models for brain tumor diagnosis in neuro-oncology is severely constrained by limited expert-annotated MRI data and substantial inter-institutional domain shift arising from variations in scanners, imaging protocols, and contrast settings. These challenges significantly impair model generalization in real-world settings. To address this, we propose a novel orientation-aware unsupervised domain-adaptive framework for automated brain tumor classification using mixed 2D MRI slices. Initially, a CNN with large receptive field first categorizes input slices into axial, sagittal, and coronal views. For each orientation, a CNN architecture with ResNet50 backbone augmented with four fully connected layers is trained to extract discriminative features for tumor classification. To mitigate annotation scarcity and domain discrepancies, we introduce a slice-wise unsupervised domain adaptation strategy that transfers knowledge from the multi-modal such as T1, T2, and FLAIR source domain to the post-contrast T1 target domain. Feature-level alignment is enforced using maximum mean discrepancy loss, complemented by pseudo-label guided adaptation to preserve class discriminability. Extensive experiments demonstrate improved target-domain performance over prior approaches, highlighting the benefits of orientation-specific learning, multi-modal knowledge transfer, pseudo-label-guided adaptation, and unsupervised domain adaptation.

医学影像无监督学习域适应脑肿瘤

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。