一种通用的测试时增强方法,可显著提升各类模型在多种任务上的表现。
Learning from Random Subspace Exploration: Generalized Test-Time Augmentation with Self-supervised Distillation
- 通过随机扰动PCA子空间生成多样化的测试样本
- 在多个任务上超越现有TTA方法,且测试计算成本更低
- 适合图像分类、检测、语音识别等广泛场景
我们提出通用测试时增强(GTTA),一种能有效提升训练模型性能的方法。与现有方法不同,GTTA可直接应用于多种视觉和非视觉任务,如分类、回归、图像分割和目标检测。其核心是通过多次随机扰动测试输入在PCA子空间的投影,生成分布内且高度多样化的增强样本,理论证明这一特性对TTA有效性至关重要。此外,我们引入一个自监督学习阶段:以集成输出作为无监督教师,重新训练初始单个学生模型,显著降低测试时计算开销。在多个知名数据集和任务(如图像分类与分割、肺炎检测、语音识别、房价预测)上的对比实验验证了GTTA的通用性。更进一步,我们在低可见度水下视频中的鲑鱼分割与检测这一实际场景中也证明了其有效性,并提出了该领域最大数据集DeepSalmon。
原文摘要 · Abstract (English)
We introduce Generalized Test-Time Augmentation (GTTA), a highly effective method for improving the performance of a trained model, which unlike other existing Test-Time Augmentation approaches from the literature is general enough to be used off-the-shelf for many vision and non-vision tasks, such as classification, regression, image segmentation and object detection. By applying a new general data transformation, that randomly perturbs multiple times the PCA subspace projection of a test input, GTTA creates valid augmented samples from the data distribution with high diversity, properties we theoretically show that are essential for a Test-Time Augmentation method to be effective. Different from other existing methods, we also propose a final self-supervised learning stage in which the ensemble output, acting as an unsupervised teacher, is used to train the initial single student model, thus reducing significantly the test time computational cost. Our comparisons to strong TTA approaches and SoTA models on various vision and non-vision well-known datasets and tasks, such as image classification and segmentation, pneumonia detection, speech recognition and house price prediction, validate the generality of the proposed GTTA. Furthermore, we also prove its effectiveness on the more specific real-world task of salmon segmentation and detection in low-visibility underwater videos, for which we introduce DeepSalmon, the largest dataset of its kind in the literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。