用弱监督训练的ViT模型实现淋巴瘤自动诊断,准确率达91.85%。
Artificial intelligence application in lymphoma diagnosis with Vision Transformer using weakly supervised training
- 采用滑片级弱监督训练,自动标注图像块,降低标注成本。
- 在10万张图像块上训练,诊断准确率91.85%,AUC达0.98。
- 适合临床场景的自动化病理图像分析,可集成至诊疗系统。
视觉变换器(ViT)具备灵活特征提取能力,在充足预训练数据下表现优于卷积神经网络(CNN)。为实现间变性大细胞淋巴瘤(ALCL)与经典型霍奇金淋巴瘤(cHL)的形态学分类,我们此前在1,200个图像块的全监督训练中构建了ViT模型,测试集准确率达100%,F1得分为1.0。但全监督训练依赖专家标注,不具临床可行性。为此,本文采用弱监督训练策略,对每张全切片图像(whole-slide image)进行滑片级自动标注,使用10万张图像块训练新模型。结果显示,该模型在独立测试集上准确率为91.85%,F1分数为0.92,曲线下面积(AUC)达0.98。这些指标表明,经弱监督训练的ViT模型具备高可靠性,适合作为临床深度学习系统中的图像分析模块。
原文摘要 · Abstract (English)
Vision transformers (ViT) have been shown to allow for more flexible feature detection and can outperform convolutional neural network (CNN) when pre-trained on sufficient data. Due to their promising feature detection capabilities, we deployed ViTs for morphological classification of anaplastic large cell lymphoma (ALCL) versus classic Hodgkin lymphoma (cHL). We had previously designed a ViT model which was trained on a small dataset of 1,200 image patches in fully supervised training. That model achieved a diagnostic accuracy of 100% and an F1 score of 1.0 on the independent test set. Since fully supervised training is not a practical method due to lack of expertise resources in both the training and testing phases, we conducted a recent study on a modified approach to training data (weakly supervised training) and show that labeling training image patch automatically at the slide level of each whole-slide-image is a more practical solution for clinical use of Vision Transformer. Our ViT model, trained on a larger dataset of 100,000 image patches, yields evaluation metrics with significant accuracy, F1 score, and area under the curve (AUC) at 91.85%, 0.92, and 0.98, respectively. These are respectable values that qualify this ViT model, with weakly supervised training, as a suitable tool for a deep learning module in clinical model development using automated image patch extraction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。