零标记视觉变压器+随机步幅增强,提升肺超声分类准确率
ZACH-ViT: A Zero-Token Vision Transformer with ShuffleStrides Data Augmentation for Robust Lung Ultrasound Classification
- 移除位置编码和[CLS] token,实现完全置换不变性
- 在380个病例上达到0.79测试ROC-AUC,敏感性0.60特异性0.91
- 参数量仅0.25M,训练速度比最小ViT快1.35倍
在肺超声视频中区分心源性肺水肿(CPE)与非心源性及结构正常肺部仍具挑战,因非心源性炎症模式(NCIP/ARDS样)、间质性肺病及健康肺部的视觉差异大,重叠的B线和胸膜伪影普遍存在。本文提出ZACH-ViT(零标记自适应紧凑分层视觉变换器),一种仅0.25百万参数的视觉变换器变体,移除了位置嵌入和[CLS]标记,实现完全置换不变性,适用于无序医学图像数据。为提升泛化能力,提出随机步幅数据增强(SSDA),在保持解剖有效性的同时打乱探头视角序列和帧顺序。ZACH-ViT在95名危重患者共380个肺超声视频上评估,对比九种先进基线模型,在非心源性组异质性强的情况下仍取得最高验证与测试ROC-AUC(0.80和0.79),敏感性0.60,特异性0.91,而所有对比模型均退化至平凡分类。其训练速度比Minimal ViT(0.62M参数)快1.35倍,参数量减少2.5倍,支持实时临床部署。结果表明,架构设计与数据结构对齐可超越规模效应,在小样本医学影像中表现更优。
原文摘要 · Abstract (English)
Differentiating cardiogenic pulmonary oedema (CPE) from non-cardiogenic and structurally normal lungs in lung ultrasound (LUS) videos remains challenging due to the high visual variability of non-cardiogenic inflammatory patterns (NCIP/ARDS-like), interstitial lung disease, and healthy lungs. This heterogeneity complicates automated classification as overlapping B-lines and pleural artefacts are common. We introduce ZACH-ViT (Zero-token Adaptive Compact Hierarchical Vision Transformer), a 0.25 M-parameter Vision Transformer variant that removes both positional embeddings and the [CLS] token, making it fully permutation-invariant and suitable for unordered medical image data. To enhance generalization, we propose ShuffleStrides Data Augmentation (SSDA), which permutes probe-view sequences and frame orders while preserving anatomical validity. ZACH-ViT was evaluated on 380 LUS videos from 95 critically ill patients against nine state-of-the-art baselines. Despite the heterogeneity of the non-cardiogenic group, ZACH-ViT achieved the highest validation and test ROC-AUC (0.80 and 0.79) with balanced sensitivity (0.60) and specificity (0.91), while all competing models collapsed to trivial classification. It trains 1.35x faster than Minimal ViT (0.62M parameters) with 2.5x fewer parameters, supporting real-time clinical deployment. These results show that aligning architectural design with data structure can outperform scale in small-data medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。