用大模型提升病理切片中分裂细胞分类,仅需10%数据就接近全量训练效果。
Benchmarking Foundation Models for Mitotic Figure Classification
- 用LoRA微调大模型,比传统线性探测更高效。
- 10%数据下性能接近全量数据,且跨肿瘤域泛化能力强。
- 适合资源有限但需高精度病理分析的临床研究者。
深度学习模型性能随数据量和多样性增加而提升。在病理学等医学影像领域,特定任务标注图像常稀缺。自监督学习使大规模无标签数据可用于训练大模型(即基础模型),提供语义丰富的特征向量,可借助极少训练快速适配新任务,提升模型性能与鲁棒性。本文研究基础模型在有丝分裂细胞分类中的应用。该分类任务所得的有丝分裂计数是某些肿瘤的独立预后标志物,也是部分肿瘤分级系统组成部分。我们考察了多种当前主流基础模型的数据缩放规律,并评估其在未见肿瘤域上的鲁棒性。除常用线性探测外,还采用低秩适应(LoRA)方法微调其注意力机制。与端到端训练的CNN和视觉变换器基线相比,结果表明:经LoRA微调的基础模型性能优于标准线性探测,在仅使用10%训练数据时即可接近100%数据下的表现;最新基础模型经LoRA微调后,在未见肿瘤域上几乎消除域间性能差距。然而,对传统架构进行全微调仍具竞争力。
原文摘要 · Abstract (English)
The performance of deep learning models is known to scale with data quantity and diversity. In pathology, as in many other medical imaging domains, the availability of labeled images for a specific task is often limited. Self-supervised learning techniques have enabled the use of vast amounts of unlabeled data to train large-scale neural networks, i.e., foundation models, that can address the limited data problem by providing semantically rich feature vectors that can generalize well to new tasks with minimal training effort increasing model performance and robustness. In this work, we investigate the use of foundation models for mitotic figure classification. The mitotic count, which can be derived from this classification task, is an independent prognostic marker for specific tumors and part of certain tumor grading systems. In particular, we investigate the data scaling laws on multiple current foundation models and evaluate their robustness to unseen tumor domains. Next to the commonly used linear probing paradigm, we also adapt the models using low-rank adaptation (LoRA) of their attention mechanisms. We compare all models against end-to-end-trained baselines, both CNNs and Vision Transformers. Our results demonstrate that LoRA-adapted foundation models provide superior performance to those adapted with standard linear probing, reaching performance levels close to 100% data availability with only 10% of training data. Furthermore, LoRA-adaptation of the most recent foundation models almost closes the out-of-domain performance gap when evaluated on unseen tumor domains. However, full fine-tuning of traditional architectures still yields competitive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。