用大模型提取皮肤切片特征,分类准确率达90%。
Foundation Models in Dermatopathology: Skin Tissue Classification
- 用Virchow2提取切片局部特征,均值聚合得整体特征
- 逻辑回归分类器在Virchow2上达90%准确率
- 适合医学影像自动化诊断研究者参考
皮肤病理学中全切片图像(WSIs)的快速生成亟需自动化处理与精准分类方法。本研究评估了两种基础模型UNI和Virchow2作为特征提取器,在将WSIs分类为黑色素细胞、基底样和鳞状病变三类中的表现。通过均值聚合策略将切片级别特征整合为滑动级表示,并训练逻辑回归、梯度提升树和随机森林等多类机器学习分类器。使用精确率、召回率、真阳性率、假阳性率及受试者工作特征曲线下面积(AUROC)在测试集上评估性能。结果表明,使用Virchow2提取的局部特征在多数滑动级分类器中优于UNI,其中逻辑回归在Virchow2上达到最高准确率90%,但差异未达统计显著性。研究还探索了数据增强与图像归一化以提升模型鲁棒性与泛化能力。均值聚合策略提供了可靠的滑动级特征表示。所有实验结果与指标均通过WandB.ai追踪与可视化,确保可复现性与可解释性。该研究展示了基础模型在自动化WSI分类中的潜力,提供了一种可扩展、高效的皮肤病理性诊断方法,为未来滑动级表征学习发展奠定基础。
原文摘要 · Abstract (English)
The rapid generation of whole-slide images (WSIs) in dermatopathology necessitates automated methods for efficient processing and accurate classification. This study evaluates the performance of two foundation models, UNI and Virchow2, as feature extractors for classifying WSIs into three diagnostic categories: melanocytic, basaloid, and squamous lesions. Patch-level embeddings were aggregated into slide-level features using a mean-aggregation strategy and subsequently used to train multiple machine learning classifiers, including logistic regression, gradient-boosted trees, and random forest models. Performance was assessed using precision, recall, true positive rate, false positive rate, and the area under the receiver operating characteristic curve (AUROC) on the test set. Results demonstrate that patch-level features extracted using Virchow2 outperformed those extracted via UNI across most slide-level classifiers, with logistic regression achieving the highest accuracy (90%) for Virchow2, though the difference was not statistically significant. The study also explored data augmentation techniques and image normalization to enhance model robustness and generalizability. The mean-aggregation approach provided reliable slide-level feature representations. All experimental results and metrics were tracked and visualized using WandB.ai, facilitating reproducibility and interpretability. This research highlights the potential of foundation models for automated WSI classification, providing a scalable and effective approach for dermatopathological diagnosis while paving the way for future advancements in slide-level representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。