用生成模型自动学习任务专属增强策略,提升小样本分类性能
Beyond Cropping and Rotation: Automated Evolution of Powerful Task-Specific Augmentations with Generative Models
- 通过进化算法优化生成式增强策略,构建分层随机增强树
- 在细粒度分类和少样本学习任务上显著提升模型准确率
- 可发现符合领域知识的增强方案,适合数据稀缺场景
数据增强长期是降低视觉模型过拟合的关键手段,传统方法如AutoAugment已能自动化设计任务特定增强。近期条件扩散模型与少样本NeRF等生成模型的发展,为数据增强提供了新范式:可合成更具多样性与真实感的数据。然而,此类方法引入的剧烈变化虽增强鲁棒性,若与任务不匹配则可能损害性能。本文提出EvoAug,一个结合生成模型与高效进化算法的自动化增强学习流程,通过学习分层组合的随机增强树,实现更结构化、自适应的图像变换。实验表明,在细粒度分类与少样本学习任务中均取得优异表现。尤其在低数据环境下,该方法能发现契合领域知识的增强策略。结果凸显了学习型生成增强的潜力,为模型鲁棒训练开辟新路径。
原文摘要 · Abstract (English)
Data augmentation has long been a cornerstone for reducing overfitting in vision models, with methods like AutoAugment automating the design of task-specific augmentations. Recent advances in generative models, such as conditional diffusion and few-shot NeRFs, offer a new paradigm for data augmentation by synthesizing data with significantly greater diversity and realism. However, unlike traditional augmentations like cropping or rotation, these methods introduce substantial changes that enhance robustness but also risk degrading performance if the augmentations are poorly matched to the task. In this work, we present EvoAug, an automated augmentation learning pipeline, which leverages these generative models alongside an efficient evolutionary algorithm to learn optimal task-specific augmentations. Our pipeline introduces a novel approach to image augmentation that learns stochastic augmentation trees that hierarchically compose augmentations, enabling more structured and adaptive transformations. We demonstrate strong performance across fine-grained classification and few-shot learning tasks. Notably, our pipeline discovers augmentations that align with domain knowledge, even in low-data settings. These results highlight the potential of learned generative augmentations, unlocking new possibilities for robust model training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。