用检索增强提升白血病细胞分类鲁棒性,跨数据集表现更稳定。
Retrieval-Augmented Vision Foundation Models for Robust Leukemia Cell Classification across Multiple Microscopy Datasets

- 两阶段框架:先分是否白血病,再细分亚型
- 引入图像检索提供形态学依据,提升跨域泛化能力
- 低成本微调+检索替代昂贵领域预训练,适合临床部署
白血病细胞图像分类受成像、染色、光照和机构协议差异影响,导致单数据集模型在真实场景中泛化能力差。本文提出一种基于预训练视觉基础模型的两阶段框架,在五个异构数据集上实现跨域分类。第一阶段使用122,167张单细胞图像进行白血病与非白血病二分类;第二阶段对第一阶段阳性样本进行亚型分类(ALL vs. AML),使用69,400张图像训练。通过标签统一实现跨数据集训练,并在保留数据集上评估域偏移下的性能。对比三种编码器(DinoBloom、BiomedCLIP、CLIP)在线性探测、低秩适配(LoRA)及检索增强分类(RAC)模块下的表现,验证领域预训练的价值与低成本适配策略的可行性。保留数据集还用于诊断,识别分类结果是否依赖于数据集特异性伪影而非真实形态特征。
原文摘要 · Abstract (English)
Leukemia cell image classification is challenged by real-world domain shifts from acquisition, staining, illumination, and site protocols, causing single-dataset models to generalize poorly in real clinical scenarios. This work presents a robust framework for leukemia classification across multiple heterogeneous datasets using a two-stage pipeline with a pretrained vision foundation model. Stage 1 performs binary classification (leukemia vs. non-leukemia) and is trained using 122,167 single-cell images. Stage 2 is conditionally applied to Stage 1 positives to perform subtype classification into Acute Lymphoblastic Leukemia (ALL) and Acute Myeloid Leukemia (AML), trained using 69,400 single-cell images. Labels are harmonized across five heterogeneous datasets to enable cross-dataset training, and performance is evaluated on a held-out dataset protocol to assess domain-shift generalization. Within this pipeline, three encoders are benchmarked (DinoBloom, pretrained on single-cell images; BiomedCLIP, pretrained on biomedical data; and CLIP as a general-purpose model) under linear probing, Low-Rank Adaptation (LoRA), and a Retrieval-Augmented Classification (RAC) module that retrieves the top-k most similar cell images to provide cytomorphological grounding. The objective is to quantify how much domain-specific pretraining contributes to performance under domain shift, and whether cost-effective adaptation and retrieval can be a viable alternative to expensive domain-specialized pretraining. The held-out protocol additionally serves as a diagnostic tool, revealing when classification performance is attributable to dataset-specific artifacts rather than to cytomorphological features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。