用随机化合成数据训练模型,提升脑影像分析的泛化能力。
Domain-randomized deep learning for neuroimage analysis
- 通过随机化图像强度和解剖结构生成合成数据训练模型
- 模型可处理未见过的扫描序列和设备类型,无需重新训练
- 适合缺乏数据或算力的医学研究者快速部署可靠模型
深度学习已显著提升脑影像分析的速度与精度,但许多训练数据集范围狭窄,限制了模型的鲁棒性与泛化能力。这一问题在磁共振成像(MRI)中尤为突出,因脉冲序列和扫描仪硬件差异导致图像外观变化大。近期提出的域随机化策略通过在随机化强度和解剖内容的合成图像上训练深度神经网络,解决了泛化难题。该方法基于解剖分割图生成多样化数据,使模型能准确处理训练中未见的图像类型,且无需再训练或微调。该方法已在MRI、CT、PET、OCT等多种模态中验证有效,并拓展至超声、电子显微镜、荧光显微镜及X射线显微断层成像等非脑影像领域。本文综述了该合成驱动训练范式的原理、实现与潜力,强调其提升泛化性和抗过拟合的优势,同时讨论计算开销增加等权衡因素。最后探讨了实际应用中的考虑因素,旨在推动通用化工具的发展,让无深度学习背景的领域专家也能便捷使用。
原文摘要 · Abstract (English)
Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute in magnetic resonance imaging (MRI), where image appearance varies widely across pulse sequences and scanner hardware. A recent domain-randomization strategy addresses the generalization problem by training deep neural networks on synthetic images with randomized intensities and anatomical content. By generating diverse data from anatomical segmentation maps, the approach enables models to accurately process image types unseen during training, without retraining or fine-tuning. It has demonstrated effectiveness across modalities including MRI, computed tomography, positron emission tomography, and optical coherence tomography, as well as beyond neuroimaging in ultrasound, electron and fluorescence microscopy, and X-ray microtomography. This tutorial paper reviews the principles, implementation, and potential of the synthesis-driven training paradigm. It highlights key benefits, such as improved generalization and resistance to overfitting, while discussing trade-offs such as increased computational demands. Finally, the article explores practical considerations for adopting the technique, aiming to accelerate the development of generalizable tools that make deep learning more accessible to domain experts without extensive computational resources or machine learning knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。