arXiv:2409.15546eess.IVcs.CV2024-09被引 14

用大模型自动分析染色血培养片,准确率超85%且无需人工标注

A Novel Framework for the Automated Characterization of Gram-Stained Blood Culture Slides Using a Large-Scale Vision Transformer

  • 基于视觉变压器的框架,免去传统方法的手动切片标注
  • 在475张全片图像上达到85.8%准确率和95.2%AUC
  • 模型跨数据集表现强,适合临床快速诊断场景

本研究提出一种新型人工智能辅助方法,用于全自动分析革兰氏染色全片图像(WSIs)。作为血液感染诊断的关键早期依据,革兰氏染色的快速可靠分析与更好临床结果相关,亟需自动化工具。本文开发了一种基于变压器的模型,相比以往依赖卷积神经网络(CNN)的方法更具可扩展性,因无需局部切片的人工标注。同时构建了来自达特茅斯-希奇科克医疗中心的大型革兰氏染色数据集,用于评估模型对五类主要形态的分类:成簇革兰氏阳性球菌、成对或链状革兰氏阳性球菌、革兰氏阳性杆菌、革兰氏阴性杆菌及无细菌滑片。在包含475张图像的数据集上,采用五折嵌套交叉验证,模型分类准确率达0.858(95%置信区间:0.805, 0.905),受试者工作特征曲线下面积(AUC)为0.952(95%置信区间:0.922, 0.976),证明大规模变压器模型在革兰氏染色分类中的潜力。进一步验证了该模型在外部数据集上的泛化能力,无需微调即可保持优异性能。

原文摘要 · Abstract (English)

This study introduces a new framework for the artificial intelligence-assisted characterization of Gram-stained whole-slide images (WSIs). As a test for the diagnosis of bloodstream infections, Gram stains provide critical early data to inform patient treatment. Rapid and reliable analysis of Gram stains has been shown to be positively associated with better clinical outcomes, underscoring the need for improved tools to automate Gram stain analysis. In this work, we developed a novel transformer-based model for Gram-stained WSI classification, which is more scalable to large datasets than previous convolutional neural network (CNN) -based methods as it does not require patch-level manual annotations. We also introduce a large Gram stain dataset from Dartmouth-Hitchcock Medical Center (Lebanon, New Hampshire, USA) to evaluate our model, exploring the classification of five major categories of Gram-stained WSIs: Gram-positive cocci in clusters, Gram-positive cocci in pairs/chains, Gram-positive rods, Gram-negative rods, and slides with no bacteria. Our model achieves a classification accuracy of 0.858 (95% CI: 0.805, 0.905) and an AUC of 0.952 (95% CI: 0.922, 0.976) using five-fold nested cross-validation on our 475-slide dataset, demonstrating the potential of large-scale transformer models for Gram stain classification. We further demonstrate the generalizability of our trained model, which achieves strong performance on external datasets without additional fine-tuning.

医学影像视觉变压器自动化诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。