揭示显微成像中深度学习学到了什么,发现现有评估方法可能失效。
Deep Learning for BioImaging: What Are We Really Learning?
- 用未训练模型和组织结构作为基线,检验学习效果
- 部分任务中基线表现与顶尖模型相当,说明评估指标不靠谱
- 提醒研究者需更真实地设计评测基准,适合生物成像领域
表示学习推动了自然图像分析的进展,使模型能获取高层语义特征。但在显微成像中,当前表示学习方法究竟学到了什么仍不明确。本文系统研究了两类最常用、最广泛的显微数据:细胞培养和组织成像,覆盖生物学中的关键尺度。我们探讨了与自然图像不同,现有模型是否无法稳定获得有意义的生物学特征。为此,我们在精心构建的基准上引入一组简单但具有启发性的基线,包括未训练模型和细胞组织的结构表示。结果表明,在相当一部分评估场景中,基线表现与当前最先进方法相当,说明许多常用基准指标不足以评估表示质量,常掩盖模型缺乏相关高层抽象的问题。此外,通过与这些基线的细致比较,我们提出了理解模型优劣的新路径,为后续改进提供依据。整体表明,显微成像表示学习的进步不仅需要更强模型,还需更具真实反映学习内容的评测基准。
原文摘要 · Abstract (English)
Representation learning has driven major advances in natural image analysis by enabling models to acquire high-level semantic features. In microscopy imaging, however, it remains unclear what current representation learning methods really learn. In this work, we conduct a systematic study of representation learning for the two most widely used and broadly available microscopy data types, representing critical scales in biology: cell culture and tissue imaging. We investigate whether, in contrast to natural images, existing models fail to consistently acquire high-level, biologically meaningful features. To this end, we introduce a set of simple yet revealing baselines on curated benchmarks, including untrained models and structural representations of cellular tissue. Our results show that, surprisingly, for a considerable subset of evaluation settings, the baselines are comparable to state-of-the-art methods, demonstrating that many commonly used benchmark metrics are insufficient to assess representation quality and often mask a lack of relevant high-level abstractions. In addition, we investigate how detailed comparisons with these baselines provide ways to interpret the strengths and weaknesses of models for further improvements. Together, our results suggest that progress in representation learning for microscopy requires not only stronger models, but also benchmarks that are more indicative of what is actually learned.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。