测试5种3D医学模型对MRI伪影的鲁棒性,发现模型表现差异大。
Do 3D Medical Foundation Models See Through MRI Artifacts? A Controlled Study of Representation Robustness

- 用7种伪影在BraTS-Africa数据上测试5个3D模型的表征稳定性。
- 3DINO最稳定,BrainIAC对伪影敏感,其他模型各有特定弱点。
- 大模型或特定领域预训练不保证抗伪影,部署前需评估鲁棒性。
自监督3D医学基础模型被广泛用作通用特征提取器,但其对MRI伪影的敏感性仍不清楚。我们对五种不同架构、目标、预训练域和数据规模的3D编码器进行了受控评估,使用BraTS-Africa病例中的四种MRI序列,生成七类频域与图像域伪影,共五个污染程度。通过线性中心核对齐(CKA)、RankMe和UMAP评估表征鲁棒性,并独立进行分割一致性分析。结果表明,鲁棒性强烈依赖模型和伪影类型:3DINO表现出最稳定的表征,BrainIAC对多个污染高度敏感;NeuroVFM、BrainFM和Neuro-SimCLR表现居中但具有特定伪影偏好。多数情况下,CKA显著下降而RankMe相对稳定,说明伪影常扭曲表征几何结构但未导致维度坍缩。分割一致性在鬼影和瑞利噪声下明显下降,但与表征级鲁棒性仅部分一致。研究显示,单纯扩大规模或特定领域预训练无法确保伪影不变性,提示应在异构MRI环境中部署前进行显式鲁棒性评估。
原文摘要 · Abstract (English)
Self-supervised 3D medical foundation models are increasingly used as general-purpose feature extractors, yet their sensitivity to MRI artifacts remains poorly understood. We present a controlled evaluation of representation robustness across five pretrained 3D encoders spanning different architectures, objectives, pretraining domains, and dataset scales. Using BraTS-Africa cases with four MRI sequences, we generate seven frequency- and image-domain artifacts at five predefined corruption settings. Robustness is assessed using linear centered kernel alignment (CKA), RankMe, and UMAP, complemented by an independent segmentation-consistency analysis. We find that robustness is strongly model- and artifact-dependent. 3DINO exhibits the most consistently stable representations, while BrainIAC is highly sensitive to several corruptions; NeuroVFM, BrainFM, and Neuro-SimCLR show intermediate but distinct artifact-specific profiles. Across many conditions, CKA decreases substantially while RankMe remains comparatively stable, indicating that artifacts often distort representation geometry without causing dimensional collapse. Segmentation consistency also degrades under corruption, particularly for ghosting and Rician noise, but aligns only partially with representation-level robustness. These findings show that larger-scale or domain-specific pretraining alone does not guarantee artifact invariance and motivate explicit robustness evaluation before deploying 3D foundation models in heterogeneous MRI settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。