用生成模型构造虚拟样本,强制模型满足空间等不变性,提升分类准确率。
Generative Hints
- 用生成模型合成无标签虚拟图像,作为训练补充。
- 在细粒度分类上最高提效2.10%,医疗影像平均提效1.29%。
- 适合需要增强模型不变性的视觉任务,如医学图像分析。
数据增强广泛用于视觉任务以引入变化并缓解过拟合,但仅间接捕捉不变性特征,无法在训练外显式约束模型行为。本文提出生成提示(Generative Hints)方法,通过训练生成模型近似输入分布并生成无标签的合成图像(称作虚拟例子),在这些虚拟样本上施加显式不变性约束目标,如空间不变性。尽管原始数据集完全标注,该方法仍以半监督方式训练:结合真实数据的标准分类损失与虚拟数据上的辅助提示损失。在多个数据集、架构、不变性类型和损失函数下,生成提示均优于标准数据增强,在细粒度视觉分类任务上最高提升2.10%,在CheXpert医疗影像数据集上平均提升1.29%。
原文摘要 · Abstract (English)
Data augmentation is widely used in vision to introduce variation and mitigate overfitting, by enabling models to learn invariant properties. However, augmentation only indirectly captures these properties and does not explicitly constrain the learned function to satisfy them beyond the empirical training set. We propose generative hints, a training methodology that directly enforces known functional invariances over the input distribution. Our approach leverages a generative model trained on the training data to approximate the input distribution and to produce unlabeled synthetic images, which we refer to as virtual examples. On these virtual examples, we impose hint objectives that explicitly constrain the model's predictions to satisfy known invariance properties, such as spatial invariance. Although the original training dataset is fully labeled, generative hints train the model in a semi-supervised manner by combining the standard classification objective on real data with an auxiliary hint objectives applied to unlabeled virtual examples. Across multiple datasets, architectures, invariance types, and loss functions, generative hints consistently outperform standard data augmentation, achieving accuracy improvements of up to 2.10% on fine-grained visual classification benchmarks and an average gain of 1.29% on the CheXpert medical imaging dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。