用Vision Transformer实现高精度、可扩展的病理癌变分类。
HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis
- 基于微调的ViT架构,直接处理切片图像,减少预处理依赖。
- 在四个癌症数据集上准确率最高达99.32%,AUC均超99%。
- 适合病理医生辅助诊断,尤其适用于多类型癌症自动筛查。
准确且可扩展的癌症诊断仍是现代病理学的关键挑战,尤其对于乳腺、前列腺、骨及宫颈癌等具有复杂组织学变异的肿瘤。本文提出一种基于Transformer的深度学习框架,用于组织病理图像的多类肿瘤分类。通过微调Vision Transformer(ViT)架构,该方法克服了传统卷积神经网络的局限性,提升了性能,降低了预处理需求,并增强了跨组织类型的可扩展性。为适配病理图像,我们设计了一条简化的预处理流程,将全切片图像分块后转为PyTorch张量,并通过数据归一化标准化,确保与ViT架构兼容,提升收敛稳定性和分类表现。我们在四个基准数据集上评估模型:ICIAR2018(乳腺)、SICAPv2(前列腺)、UT-Osteosarcoma(骨)和SipakMed(宫颈),结果表明其性能持续优于现有深度学习方法。该方法在乳腺、前列腺、骨及宫颈癌分类中分别取得99.32%、96.92%、95.28%和96.94%的准确率,所有数据集的ROC曲线下面积(AUC)均超过99%。这些结果证实了基于Transformer架构在数字病理中的鲁棒性、泛化能力与临床潜力。本研究推动了可靠、自动化且可解释的癌症诊断系统的发展,有望减轻诊断负担并改善医疗效果。
原文摘要 · Abstract (English)
Accurate and scalable cancer diagnosis remains a critical challenge in modern pathology, particularly for malignancies such as breast, prostate, bone, and cervical, which exhibit complex histological variability. In this study, we propose a transformer-based deep learning framework for multi-class tumor classification in histopathological images. Leveraging a fine-tuned Vision Transformer (ViT) architecture, our method addresses key limitations of conventional convolutional neural networks, offering improved performance, reduced preprocessing requirements, and enhanced scalability across tissue types. To adapt the model for histopathological cancer images, we implement a streamlined preprocessing pipeline that converts tiled whole-slide images into PyTorch tensors and standardizes them through data normalization. This ensures compatibility with the ViT architecture and enhances both convergence stability and overall classification performance. We evaluate our model on four benchmark datasets: ICIAR2018 (breast), SICAPv2 (prostate), UT-Osteosarcoma (bone), and SipakMed (cervical) dataset -- demonstrating consistent outperformance over existing deep learning methods. Our approach achieves classification accuracies of 99.32%, 96.92%, 95.28%, and 96.94% for breast, prostate, bone, and cervical cancers respectively, with area under the ROC curve (AUC) scores exceeding 99% across all datasets. These results confirm the robustness, generalizability, and clinical potential of transformer-based architectures in digital pathology. Our work represents a significant advancement toward reliable, automated, and interpretable cancer diagnosis systems that can alleviate diagnostic burdens and improve healthcare outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。