ZACH-ViT在低数据医疗图像中表现出强鲁棒性,抗干扰能力优于同类模型。
Extending ZACH-ViT to Robust Medical Imaging: Corruption and Adversarial Stress Testing in Low-Data Regimes

- 采用无位置编码的紧凑排列不变架构,适应医学图像的空间不确定性
- 50样本/类下,清洁数据与常见噪声下平均排名均达1.57,领先于基线
- 在对抗攻击中仍保持竞争力,尤其在FGSM攻击下排名第一
新提出的ZACH-ViT(零标记自适应紧凑分层视觉变换器)为医学图像设计了一种紧凑的排列不变视觉变换器,强调架构与空间结构对齐的重要性。其设计源于观察:位置嵌入和专用分类标记会引入固定的几何假设,在空间组织弱或局部分布不一的生物医学图像中可能不优。原研究在MedMNIST上建立了依赖任务的干净性能基准,但未深入评估鲁棒性。本文首次对ZACH-ViT进行鲁棒性扩展,测试其在低数据设置下(每类50样本)面对常见图像退化与对抗扰动的表现。对比三个从头训练的紧凑基线模型:ABMIL、Minimal-ViT和TransMIL,使用五个随机种子,在七个MedMNIST数据集上评估。结果显示,ZACH-ViT在干净数据(平均排名1.57)和常见噪声下(平均排名1.57)表现最佳;在对抗攻击下,所有模型性能显著下降,但ZACH-ViT仍具优势:在FGSM攻击下排名第一(2.00),在PGD攻击下排名第二(2.29),其中ABMIL整体最优。结果表明,紧凑排列不变变换器的优势不仅存在于干净评估,也能在真实扰动下维持,而对抗鲁棒性仍是所有模型的挑战。
原文摘要 · Abstract (English)
The recently introduced ZACH-ViT (Zero-token Adaptive Compact Hierarchical Vision Transformer) formalized a compact permutation-invariant Vision Transformer for medical imaging and argued that architectural alignment with spatial structure can matter more than universal benchmark dominance. Its design was motivated by the observation that positional embeddings and a dedicated class token encode fixed spatial assumptions that may be suboptimal when spatial organization is weakly informative, locally distributed, or variable across biomedical images. The foundational study established a regime-dependent clean performance profile across MedMNIST, but did not examine robustness in detail. In this work, we present the first robustness-focused extension of ZACH-ViT by evaluating its behavior under common image corruptions and adversarial perturbations in the same low-data setting. We compare ZACH-ViT with three scratch-trained compact baselines, ABMIL, Minimal-ViT, and TransMIL, on seven MedMNIST datasets using 50 samples per class, fixed hyperparameters, and five random seeds. Across the benchmark, ZACH-ViT achieves the best overall mean rank on clean data (1.57) and under common corruptions (1.57), indicating a favorable balance between baseline predictive performance and robustness to realistic image degradation. Under adversarial stress, all models deteriorate substantially; nevertheless, ZACH-ViT remains competitive, ranking first under FGSM (2.00) and second under PGD (2.29), where ABMIL performs best overall. These results extend the original ZACH-ViT narrative: the advantages of compact permutation-invariant transformers are not limited to clean evaluation, but can persist under realistic perturbation stress in low-data medical imaging, while adversarial robustness remains an open challenge for all evaluated models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。