arXiv:2509.08234cs.CVcs.LG2025-09被引 10

用通道复制让ViT直接处理单通道胸片,准确率超99%。

RepViT-CXR: A Channel Replication Strategy for Vision Transformers in Chest X-ray Tuberculosis and Pneumonia Classification

  • 将灰度胸片通过复制通道转为三通道输入,适配ViT架构
  • 在TB-CXR上达99.9%准确率,显著超越现有方法
  • 方法简单有效,适合临床肺病筛查系统部署

胸片(CXR)是检测结核病(TB)和肺炎等肺部疾病的常用诊断工具。近年来,视觉变换器(ViTs)在自动医学图像分析中展现出强大潜力。然而,多数ViT模型基于自然图像预训练,需三通道输入,而胸片本质为灰度图。为此,本文提出RepViT-CXR,一种通道复制策略,将单通道胸片转化为ViT兼容格式,且不引入额外信息损失。我们在三个基准数据集上评估该方法:在TB-CXR数据集上,准确率达99.9%,AUC为99.9%,优于Topo-CXR(99.3%准确率,99.8% AUC);在儿科肺炎数据集上,准确率为99.0%,召回率99.2%,精确率99.3%,AUC为99.0%,优于DCNN和VGG16等强基线;在深圳结核病数据集上,准确率为91.1%,AUC为91.2%,较此前基于CNN的方法有所提升。结果表明,这种简单有效的通道复制策略使ViT能充分发挥其表征能力于灰度医学影像任务中。RepViT-CXR在胸片结核与肺炎检测上建立了新基准,具备实际临床筛查系统的应用潜力。

原文摘要 · Abstract (English)

Chest X-ray (CXR) imaging remains one of the most widely used diagnostic tools for detecting pulmonary diseases such as tuberculosis (TB) and pneumonia. Recent advances in deep learning, particularly Vision Transformers (ViTs), have shown strong potential for automated medical image analysis. However, most ViT architectures are pretrained on natural images and require three-channel inputs, while CXR scans are inherently grayscale. To address this gap, we propose RepViT-CXR, a channel replication strategy that adapts single-channel CXR images into a ViT-compatible format without introducing additional information loss. We evaluate RepViT-CXR on three benchmark datasets. On the TB-CXR dataset,our method achieved an accuracy of 99.9% and an AUC of 99.9%, surpassing prior state-of-the-art methods such as Topo-CXR (99.3% accuracy, 99.8% AUC). For the Pediatric Pneumonia dataset, RepViT-CXR obtained 99.0% accuracy, with 99.2% recall, 99.3% precision, and an AUC of 99.0%, outperforming strong baselines including DCNN and VGG16. On the Shenzhen TB dataset, our approach achieved 91.1% accuracy and an AUC of 91.2%, marking a performance improvement over previously reported CNN-based methods. These results demonstrate that a simple yet effective channel replication strategy allows ViTs to fully leverage their representational power on grayscale medical imaging tasks. RepViT-CXR establishes a new state of the art for TB and pneumonia detection from chest X-rays, showing strong potential for deployment in real-world clinical screening systems.

视觉变换器医学影像胸片分析通道复制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。