arXiv:2409.06290cs.CV2024-09ECCV被引 21

基于熵值自适应调整数据增强强度,提升图像分类泛化能力。

EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classification

  • 根据模型输出概率分布的熵值动态调节每张图的增强强度
  • 在多个数据集和网络上均超越现有方法,且无额外计算开销
  • 适合追求高效高精度图像分类的工程师和研究者

数据增强(DA)广泛用于提升深度神经网络的泛化性能。现有方法多对每张样本随机应用增强操作,可能引入噪声、引发分布偏移并增加过拟合风险。本文提出EntAugment,一种无需调参的自适应数据增强框架。不同于以往方法,EntAugment在训练中动态评估并调整每张样本的增强强度,结合样本内在复杂度与模型演化状态。具体地,增强幅度由模型输出经Softmax后概率分布的信息熵决定。此外,我们提出新型熵正则项EntLoss,进一步提升效果。理论分析表明,相比传统交叉熵损失,EntLoss能更贴近模型分布与真实数据分布的一致性。EntAugment与EntLoss可独立或联合使用。在多个图像分类任务与网络结构上进行大量实验,结果表明该方法优于现有方法,且不引入额外模型或显著计算成本,兼具有效性与高效性。代码已开源。

原文摘要 · Abstract (English)

Data augmentation (DA) has been widely used to improve the generalization of deep neural networks. While existing DA methods have proven effective, they often rely on augmentation operations with random magnitudes to each sample. However, this approach can inadvertently introduce noise, induce distribution shifts, and increase the risk of overfitting. In this paper, we propose EntAugment, a tuning-free and adaptive DA framework. Unlike previous work, EntAugment dynamically assesses and adjusts the augmentation magnitudes for each sample during training, leveraging insights into both the inherent complexities of training samples and the evolving status of deep models. Specifically, in EntAugment, the magnitudes are determined by the information entropy derived from the probability distribution obtained by applying the softmax function to the model's output. In addition, to further enhance the efficacy of EntAugment, we introduce a novel entropy regularization term, EntLoss, which complements the EntAugment approach. Theoretical analysis further demonstrates that EntLoss, compared to traditional cross-entropy loss, achieves closer alignment between the model distributions and underlying dataset distributions. Moreover, EntAugment and EntLoss can be utilized separately or jointly. We conduct extensive experiments across multiple image classification tasks and network architectures with thorough comparisons of existing DA methods. Importantly, the proposed methods outperform others without introducing any auxiliary models or noticeable extra computational costs, highlighting both effectiveness and efficiency. Code is available at https://github.com/Jackbrocp/EntAugment.

数据增强自适应熵正则图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。