arXiv:2411.02592cs.CVcs.AI2024-11被引 9

分离图像的类别相关与无关部分,实现保真与多样性的平衡。

Decoupled Data Augmentation for Improving Image Classification

  • 将图像拆分为类别相关/无关部分,分别处理以解耦保真与多样性
  • 在真实类别相关部分上生成修改,保持语义一致;替换类别无关部分提升多样性
  • 训练时随机组合不同组合,低成本生成大量新颖样本

近期图像混合与生成式数据增强在提升图像分类性能方面展现出潜力,但面临保真度与多样性之间的权衡难题。图像混合通过像素级插值生成新图像,可能破坏语义保真;生成式增强使用文本到图像模型合成或修改图像,常因限制多样性而避免生成分布外数据,影响准确率。本文提出,这一困境部分源于现有方法对整图统一处理的范式。由于图像包含类别相关部分(CDP)和类别无关部分(CIP),二者对保真度的影响机制不同,统一处理会带来误导。为此,我们提出解耦数据增强(De-DA),将图像分解为CDP与CIP,分别适应性处理:利用生成模型在受控条件下修改真实CDP以维持语义一致性;用跨类变体替换图像的CIP,生成多样化的CDP-CIP组合。此外,我们在训练中引入在线随机组合策略,高效生成大量独特组合。大量实验证明该方法有效。

原文摘要 · Abstract (English)

Recent advancements in image mixing and generative data augmentation have shown promise in enhancing image classification. However, these techniques face the challenge of balancing semantic fidelity with diversity. Specifically, image mixing involves interpolating two images to create a new one, but this pixel-level interpolation can compromise fidelity. Generative augmentation uses text-to-image generative models to synthesize or modify images, often limiting diversity to avoid generating out-of-distribution data that potentially affects accuracy. We propose that this fidelity-diversity dilemma partially stems from the whole-image paradigm of existing methods. Since an image comprises the class-dependent part (CDP) and the class-independent part (CIP), where each part has fundamentally different impacts on the image's fidelity, treating different parts uniformly can therefore be misleading. To address this fidelity-diversity dilemma, we introduce Decoupled Data Augmentation (De-DA), which resolves the dilemma by separating images into CDPs and CIPs and handling them adaptively. To maintain fidelity, we use generative models to modify real CDPs under controlled conditions, preserving semantic consistency. To enhance diversity, we replace the image's CIP with inter-class variants, creating diverse CDP-CIP combinations. Additionally, we implement an online randomized combination strategy during training to generate numerous distinct CDP-CIP combinations cost-effectively. Comprehensive empirical evaluations validate the effectiveness of our method.

数据增强图像分类生成模型解耦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。