用卫星图像预训练模型,提升眼科影像分析效果。
Beyond Natural-Image Foundation Models: Benchmarking Satellite Pretraining for Ophthalmic Image Analysis

- 用4.93亿张卫星图预训练模型,替代自然图像
- 在高分辨率血管图像任务上达到医学专用模型水平
- 无需医疗数据,适合隐私敏感场景
视觉基础模型(VFMs)在医学影像中展现出广阔应用前景,但其发展受限于数据量不足、隐私问题和高昂成本。现有医学基础模型多基于自然图像预训练,导致与医学图像存在显著分布差异。本文提出以卫星图像作为新型预训练领域,因其视觉特征更接近医学影像且无隐私限制。我们在多个眼科影像模态上对比DINOv3-SAT493m(4.93亿张卫星图预训练)与DINOv3-LVD1689m(17亿张自然图像预训练),以及两种医学专用基线模型。结果表明,卫星图像预训练在富含血管的平面影像任务上优于自然图像预训练,部分任务性能达到或超过医学专用模型,且完全不使用医疗数据。
原文摘要 · Abstract (English)
Vision Foundation Models (VFMs) have emerged as a promising approach in medical imaging, producing broadly applicable systems that can be efficiently adapted across diverse imaging modalities, anatomical regions, and clinical tasks. However, VFMs require extensive training data, and their progress in medical image analysis is constrained by limited data availability, privacy concerns, and high development costs. To alleviate these constraints, medical VFMs (MedVFMs) are often built upon weights from generalist models pretrained on vast amounts of publicly available natural images, introducing a substantial distribution shift for medical task adaptation. To address this, we propose satellite imagery as a novel pretraining domain for MedVFM development and benchmarking, motivated by its closer visual alignment with medical data and its freedom from the privacy constraints that limit medical datasets. Across multiple ophthalmic imaging modalities, we compare DINOv3-SAT493m pretrained on 493 million satellite images against DINOv3-LVD1689m pretrained on 1.7 billion natural images, together with two medical specialist baselines: DINOv3-RETFound and MAE-RETFound. Our experiments show that satellite imagery is a stronger pretraining source than natural images for ophthalmic tasks, particularly on en face vascular-rich modalities. On several tasks, satellite pretraining matches or exceeds the medical specialists on high-resolution en face inputs, despite using no medical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。