根据模型学习状态动态选择数据增强,提升小样本下的泛化能力。
ActiveAugment: Online Active Learning for Augmentation Selection in Deep Learning

- 将增强选择建模为在线主动学习,按样本脆弱性动态选增广。
- 在低标注预算下超越AutoAugment等基线,医学图像上F1显著更高。
- 适配小样本、医疗影像等数据稀缺场景,对模型泛化有直接影响。
数据增强是深度学习的核心环节,但现有方法多将其视为静态、与模型无关的预处理步骤,要么依赖昂贵的数据集特异性策略搜索,要么随机统一应用变换,忽视模型已学知识。本文提出ActiveAugment,将增强选择建模为在线主动学习问题:每个训练小批量生成候选增强视图,通过模型预测不确定性和增强引起的特征差异联合评分,选择使当前模型最脆弱的增强方式。随后以监督分类与监督对比损失联合训练,强化对所选增强的类内不变性并保持类间分离。在涵盖自然与医学图像的八个基准数据集上,使用CNN和Transformer架构,评估了三种训练范式(从头训练、全微调、线性探测)及八种主动选择策略。ActiveAugment在所有领域和数据预算下均优于AutoAugment、RandAugment和TrivialAugment,低标注预算下优势最显著。在数据稀缺且与自然图像预训练模型存在较大域偏移的医学图像上,其测试F1高于所有基线,体现强跨域适应性。分析显示,增强选择策略随训练过程动态演化,策略选择直接影响泛化性能。代码开源:https://github.com/noahvide/ActiveAugment。
原文摘要 · Abstract (English)
Data augmentation is a cornerstone of deep learning pipelines, yet existing strategies treat it as a static, model-agnostic preprocessing step, either relying on expensive dataset-specific policy search or applying transformations uniformly at random, regardless of what the model has already learned. We introduce ActiveAugment, a unified framework that treats augmentation selection as an online active learning problem. For each training minibatch, ActiveAugment generates a pool of candidate augmented views and scores each candidate using a combination of the model's predictive uncertainty and the feature discrepancy induced by the augmentation. The augmentation under which the current model is most fragile is selected per sample, and the model is then trained with a joint supervised classification and supervised contrastive objective that enforces intra-class invariance to the selected augmentations while maintaining inter-class separation. We evaluate ActiveAugment on eight benchmark datasets spanning natural and medical imaging, using CNN and transformer architectures across three training regimes (training from scratch, full fine-tuning, and linear probing), and comparing eight active selection strategies for augmentation scoring. ActiveAugment outperforms AutoAugment, RandAugment, and TrivialAugment under controlled augmentation shifts across all domains and budgets, with the most pronounced gains at low labelling budgets. On medical imaging datasets, where data is scarce and domain shift relative to natural-image pretrained models is large, ActiveAugment achieves higher test F1 than all baselines, demonstrating strong cross-domain adaptability. Our analysis reveals that the augmentation selection policy evolves meaningfully during training and that strategy choice has a direct impact on generalisation. Code is available at: https://github.com/noahvide/ActiveAugment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。