arXiv:2510.15684cs.CVcs.AI2025-10被引 5

用无标签MRI训练模型,自动定位脑肿瘤,省去人工标注

Towards Label-Free Brain Tumor Segmentation: Unsupervised Learning with Multimodal MRI

  • 用健康脑部MRI训练视觉变压器自编码器,通过重建误差找肿瘤
  • 在测试集上整体肿瘤分割Dice达0.437,小病灶检测率89.4%
  • 适合缺乏标注数据的脑肿瘤研究者,尤其关注小或不强化病灶

无监督异常检测(UAD)为脑肿瘤分割提供替代方案,尤其在标注数据稀缺、昂贵或不一致时。本文提出一种仅在健康脑MRI上训练的多模态视觉变压器自编码器(MViT-AE),通过重建误差图实现肿瘤检测与定位。该方法无需人工标签,突破神经影像流程的可扩展性瓶颈。我们在BraTS-GoAT 2025 Lighthouse数据集上评估,涵盖胶质瘤、脑膜瘤及儿童脑肿瘤等类型。为提升性能,引入多模态早-晚融合策略以整合多序列信息,并结合Segment Anything Model(SAM)后处理细化肿瘤边界。尽管存在小病灶或非强化病灶检测挑战,本方法仍取得临床有意义的定位效果:测试集上病变级Dice相似系数为0.437(全肿瘤)、0.316(肿瘤核心)、0.350(增强肿瘤),验证集异常检测率达89.4%。结果表明,基于变压器的无监督模型具备作为高效、低标签依赖神经肿瘤影像工具的潜力。

原文摘要 · Abstract (English)

Unsupervised anomaly detection (UAD) presents a complementary alternative to supervised learning for brain tumor segmentation in magnetic resonance imaging (MRI), particularly when annotated datasets are limited, costly, or inconsistent. In this work, we propose a novel Multimodal Vision Transformer Autoencoder (MViT-AE) trained exclusively on healthy brain MRIs to detect and localize tumors via reconstruction-based error maps. This unsupervised paradigm enables segmentation without reliance on manual labels, addressing a key scalability bottleneck in neuroimaging workflows. Our method is evaluated in the BraTS-GoAT 2025 Lighthouse dataset, which includes various types of tumors such as gliomas, meningiomas, and pediatric brain tumors. To enhance performance, we introduce a multimodal early-late fusion strategy that leverages complementary information across multiple MRI sequences, and a post-processing pipeline that integrates the Segment Anything Model (SAM) to refine predicted tumor contours. Despite the known challenges of UAD, particularly in detecting small or non-enhancing lesions, our method achieves clinically meaningful tumor localization, with lesion-wise Dice Similarity Coefficient of 0.437 (Whole Tumor), 0.316 (Tumor Core), and 0.350 (Enhancing Tumor) on the test set, and an anomaly Detection Rate of 89.4% on the validation set. These findings highlight the potential of transformer-based unsupervised models to serve as scalable, label-efficient tools for neuro-oncological imaging.

脑肿瘤分割无监督学习多模态MRITransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。