arXiv:2508.11864cs.CV2025-08中稿 · the 1st MICCAI Wor…被引 3

医学影像质量影响大模型微调效果,高质量图像不足会导致性能下降甚至不如不预训练。

Impact of Clinical Image Quality on Efficient Foundation Model Finetuning

  • 用前列腺多模态MRI数据测试大模型微调,系统调整训练与测试集的图像质量比例。
  • 微调时若缺乏高质量图像,模型表现会显著下降,甚至不如无预训练的模型。
  • 不同任务对图像质量匹配的要求不同,自动化报告和癌症检测差异明显。

医学影像中的基础模型展现出优异的标签效率,仅需少量标注数据即可在下游任务中取得高精度。本研究以近期开发的领域专用视觉基础模型ProFound为例,基于大规模前列腺MRI数据集预训练,在前列腺多模态MRI场景下评估其标签高效微调的潜力。通过系统性地改变微调与评估集中高质量与低质量图像的比例,量化模型泛化能力。结果表明:1)微调与测试集间图像质量分布不一致会显著影响下游性能;2)微调集必须包含足够高质量图像才能维持强性能,而质量分布匹配的重要性因任务而异,如自动化放射科报告与前列腺癌检测任务表现差异明显。值得注意的是,尽管在质量分布一致时,微调比从头训练节省大量标注数据,但这种标签效率并非独立于图像质量分布——当微调集中缺乏高质量图像时,微调模型可能无法超越无预训练模型。

原文摘要 · Abstract (English)

Foundation models in medical imaging have shown promising label efficiency, achieving high performance on downstream tasks using only a fraction of the annotated data otherwise required. In this study, we evaluate this potential in the context of prostate multiparametric MRI using ProFound, a recently developed domain-specific vision foundation model pretrained on large-scale prostate MRI datasets. We investigate the impact of variable image quality on the label-efficient finetuning, by quantifying the generalisability of the finetuned models. We conduct a comprehensive set of experiments by systematically varying the ratios of high- and low-quality images in the finetuning and evaluation sets. Our findings indicate that image quality distribution and its finetune-and-test mismatch significantly affect model performance. In particular: a) Varying the ratio of high- to low-quality images between finetuning and test sets leads to notable differences in downstream performance; and b) The presence of sufficient high-quality images in the finetuning set is critical for maintaining strong performance, whilst the importance of matched finetuning and testing distribution varies between different downstream tasks, such as automated radiology reporting and prostate cancer detection. Importantly, experimental results also show that, although finetuning requires significantly less labeled data compared to training from scratch when the quality ratio is consistent, this label efficiency is not independent of the image quality distribution. For example, we show cases that, without sufficient high-quality images in finetuning, finetuned models may fail to outperform those without pretraining.

医学影像大模型微调图像质量标签效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。