首篇系统综述脑影像基础模型,梳理86种架构与161个数据集。
Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research
- 系统分析161个脑影像数据集与86种基础模型架构
- 揭示多模态融合与异构数据处理的关键挑战
- 适合神经影像研究者与临床AI开发者参考
基础模型(Foundation Models, FMs)是通过大规模多样化数据预训练的大型神经网络,在人工智能领域引发变革,并在医疗影像中展现出以少量标注数据实现强性能的潜力。尽管已有诸多关于医学影像中基础模型的应用综述,但脑影像领域仍被严重低估,尽管其在使用MRI、CT和PET等模态诊断与治疗神经系统疾病中至关重要。现有综述或忽视脑影像,或对本领域独特挑战(如多模态数据融合、支持多样临床任务、处理异构碎片化数据集)缺乏深入探讨。为填补这一空白,本文首次系统性、全面地综述脑影像中的基础模型。我们分析了161个脑影像数据集与86种基础模型架构,涵盖关键设计选择、训练范式及优化策略,揭示推动近期进展的核心因素。论文总结领先模型在各类脑影像任务中的创新,批判性评估当前文献的局限与盲点,并提出未来研究方向,旨在促进临床与科研场景中基础模型应用的发展。
原文摘要 · Abstract (English)
Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled data. Although numerous surveys have reviewed the application of FM in healthcare care, brain imaging remains underrepresented, despite its critical role in the diagnosis and treatment of neurological diseases using modalities such as MRI, CT, and PET. Existing reviews either marginalize brain imaging or lack depth on the unique challenges and requirements of FM in this domain, such as multimodal data integration, support for diverse clinical tasks, and handling of heterogeneous, fragmented datasets. To address this gap, we present the first comprehensive and curated review of FMs for brain imaging. We systematically analyze 161 brain imaging datasets and 86 FM architectures, providing information on key design choices, training paradigms, and optimizations driving recent advances. Our review highlights the leading models for various brain imaging tasks, summarizes their innovations, and critically examines current limitations and blind spots in the literature. We conclude by outlining future research directions to advance FM applications in brain imaging, with the aim of fostering progress in both clinical and research settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。