揭示预训练模型在医学影像迁移中的表现机制,解释为何跨域效果仍佳。
Pre-trained Models Succeed in Medical Imaging with Representation Similarity Degradation
- 通过分析表征相似性演化轨迹,量化模型迁移过程中的特征保留程度。
- 发现层间相似性与表征质量存在强线性相关,且部分模型能同时保持精度与相似性。
- 揭示监督与自监督预训练在适应模式上的本质差异,适用于医疗影像与跨域任务研究者。
本文研究跨域迁移学习中表征相似性的演化问题,聚焦于为何预训练模型在适应医学影像任务时仍具高效性,尽管存在显著领域差异。研究建立严谨的问题定义,通过量化分析微调过程中表征相似性的时间轨迹,并明确涵盖医学图像分析与更广泛的跨域适配场景。实验发现三个关键现象:可能存在既保持任务精度又维持与预训练源相似性的高性能模型;层间相似性度量与表征质量指标之间存在稳健线性相关;监督与自监督预训练范式表现出明显不同的适应模式。提出的相似性空间框架不仅为知识迁移机制提供深层洞察,也引发关于预训练模型最优利用方式的根本性思考。这些结果深化了对神经网络适应过程的理解,同时为超越医学影像的迁移学习策略提供实践指导。代码将在录用后公开。
原文摘要 · Abstract (English)
This paper investigates the critical problem of representation similarity evolution during cross-domain transfer learning, with particular focus on understanding why pre-trained models maintain effectiveness when adapted to medical imaging tasks despite significant domain gaps. The study establishes a rigorous problem definition centered on quantifying and analyzing representation similarity trajectories throughout the fine-tuning process, while carefully delineating the scope to encompass both medical image analysis and broader cross-domain adaptation scenarios. Our empirical findings reveal three critical discoveries: the potential existence of high-performance models that preserve both task accuracy and representation similarity to their pre-trained origins; a robust linear correlation between layer-wise similarity metrics and representation quality indicators; and distinct adaptation patterns that differentiate supervised versus self-supervised pre-training paradigms. The proposed similarity space framework not only provides mechanistic insights into knowledge transfer dynamics but also raises fundamental questions about optimal utilization of pre-trained models. These results advance our understanding of neural network adaptation processes while offering practical implications for transfer learning strategies that extend beyond medical imaging applications. The code will be available once accepted.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。