arXiv:2509.17566cs.CVcs.AI2025-09

用2D视觉模型分析3D脑部MRI,仅用300例数据实现86%帕金森病诊断准确率。

MRN: Harnessing 2D Vision Foundation Models for Diagnosing Parkinson's Disease with Limited 3D MR Data

  • 将3D脑影像切片为多个区域,用2D模型分别编码再融合成患者特征
  • 通过对比学习提升同类别患者特征相似度,准确率达86.0%
  • 适合缺乏大规模3D医学数据的临床诊断场景

帕金森病的自动诊断因高发病率和精准治疗需求而备受关注。当前临床依赖QSM与NM-MRI中的生物标志物,但高质量数据集稀缺导致模型易过拟合。直接适配预训练3D模型也因体素间距与模态差异难以实现。本文提出利用2D视觉基础模型(VFMs)解决该问题:从NM和QSM图像中裁剪多个关键脑区(ROIs),通过独立分支将每个ROI压缩为特征向量,并融合生成患者级表示用于分类。每一分支使用2D VFMs编码轴向切片,结合辅助分割头引导特征提取聚焦特定脑核。同时引入多区域监督对比学习,增强同类患者表征相似性、拉大异类差距。在仅300例标注数据下,本方法于MICCAI 2025 PDCADxFoundation挑战赛中取得86.0%准确率,领先第二名5.5个百分点,验证了2D VFM在3D MRI临床分析中的潜力。

原文摘要 · Abstract (English)

The automatic diagnosis of Parkinson's disease is in high clinical demand due to its prevalence and the importance of targeted treatment. Current clinical practice often relies on diagnostic biomarkers in QSM and NM-MRI images. However, the lack of large, high-quality datasets makes training diagnostic models from scratch prone to overfitting. Adapting pre-trained 3D medical models is also challenging, as the diversity of medical imaging leads to mismatches in voxel spacing and modality between pre-training and fine-tuning data. In this paper, we address these challenges by leveraging 2D vision foundation models (VFMs). Specifically, we crop multiple key ROIs from NM and QSM images, process each ROI through separate branches to compress the ROI into a token, and then combine these tokens into a unified patient representation for classification. Within each branch, we use 2D VFMs to encode axial slices of the 3D ROI volume and fuse them into the ROI token, guided by an auxiliary segmentation head that steers the feature extraction toward specific brain nuclei. Additionally, we introduce multi-ROI supervised contrastive learning, which improves diagnostic performance by pulling together representations of patients from the same class while pushing away those from different classes. Our approach achieved first place in the MICCAI 2025 PDCADxFoundation challenge, with an accuracy of 86.0% trained on a dataset of only 300 labeled QSM and NM-MRI scans, outperforming the second-place method by 5.5%.These results highlight the potential of 2D VFMs for clinical analysis of 3D MR images.

帕金森病2D模型医学影像对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。