TTA在医学图像分类中反而降低准确率,需谨慎使用
I Can't Believe TTA Is Not Better: When Test-Time Augmentation Hurts Medical Image Classification
- 发现标准TTA会因输入分布偏移导致准确率下降
- 最大降幅达31.6个百分点,仅皮肤病数据集微增1.6%
- 建议对具体模型-数据组合验证再用,勿默认部署
测试时增强(TTA)——通过聚合多个增强后测试样本的预测结果——普遍被认为能提升分类精度,尤其在医学影像领域被广泛用于生产系统和竞赛方案。我们对三个MedMNIST v2基准和四种架构(参数量从21K到11M不等)进行了系统性实证研究,发现使用标准增强流程的TTA始终导致准确率下降,相对于单次前向推理,降幅最高达31.6个百分点(以病理图像上的ResNet-18为例)。该现象影响所有架构,包括卷积模型,且随着增强视图增多而加剧。唯一例外是ResNet-18在皮肤科图像上获得+1.6%的微小提升。我们识别出主要机制为增强输入与训练输入之间的分布偏移,尤其是批归一化统计量不匹配所放大。消融实验表明,仅增强强度的策略优于几何变换,包含原始未增强图像可部分缓解但无法消除性能下降。研究提醒实践者:TTA不应作为默认的后期优化手段,必须针对特定模型-数据组合进行验证。
原文摘要 · Abstract (English)
Test-time augmentation (TTA)--aggregating predictions over multiple augmented copies of a test input--is widely assumed to improve classification accuracy, particularly in medical imaging where it is routinely deployed in production systems and competition solutions. We present a systematic empirical study challenging this assumption across three MedMNIST v2 benchmarks and four architectures spanning three orders of magnitude in parameter count (21K to 11M). Our principal finding is that TTA with standard augmentation pipelines consistently degrades accuracy relative to single-pass inference, with drops as severe as 31.6 percentage points for ResNet-18 on pathology images. This degradation affects all architectures, including convolutional models, and worsens with more augmented views. The sole exception is ResNet-18 on dermatology images, which gains a modest +1.6%. We identify the distribution shift between augmented and training-time inputs--amplified by batch normalization statistics mismatch--as the primary mechanism. Our ablation studies show that augmentation strategy matters critically: intensity-only augmentations preserve more performance than geometric transforms, and including the original unaugmented image partially mitigates but does not eliminate the accuracy drop. These findings serve as a cautionary note for practitioners: TTA should not be applied as a default post-hoc improvement but must be validated on the specific model-dataset combination.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。