arXiv:2512.00130cs.CV2025-12被引 12

用超像素融合局部与全局信息,提升图像增强效果。

Local and Global Context-and-Object-part-Aware Superpixel-based Data Augmentation for Deep Visual Recognition

  • 基于超像素的网格混合策略,捕捉物体局部特征。
  • 在多个数据集上超越现有方法,分类准确率提升1.2%以上。
  • 适用于CNN与Transformer,适合视觉识别研究者参考。

基于Cutmix的数据增强方法通过裁剪粘贴策略,在深度学习中展现出出色的泛化能力。然而,现有方法主要依赖图像级全局语义约束,过度忽略类别判别性局部上下文,导致性能提升受限。同时,传统方法通常裁剪粘贴矩形或方形区域,造成物体部件信息丢失。为解决增强图像与生成标签不一致的问题,现有方法常需双前向传播或依赖外部预训练网络进行物体中心定位,效率低下。为此,本文提出LGCOAMix——一种高效、上下文感知且物体部件感知的超像素基网格混合数据增强方法。据我们所知,这是首个采用超像素注意力机制的Cutmix类标签混合策略,首次实现从判别性超像素区域学习局部特征,并进行跨图像超像素对比。大量实验表明,LGCOAMix在多个基准数据集上的分类任务和弱监督物体定位任务(如CUB200-2011)中均优于当前最优的Cutmix方法。该方法不仅适用于CNN网络,也适用于Transformer网络。源代码已公开于https://github.com/DanielaPlusPlus/LGCOAMix。

原文摘要 · Abstract (English)

Cutmix-based data augmentation, which uses a cut-and-paste strategy, has shown remarkable generalization capabilities in deep learning. However, existing methods primarily consider global semantics with image-level constraints, which excessively reduces attention to the discriminative local context of the class and leads to a performance improvement bottleneck. Moreover, existing methods for generating augmented samples usually involve cutting and pasting rectangular or square regions, resulting in a loss of object part information. To mitigate the problem of inconsistency between the augmented image and the generated mixed label, existing methods usually require double forward propagation or rely on an external pre-trained network for object centering, which is inefficient. To overcome the above limitations, we propose LGCOAMix, an efficient context-aware and object-part-aware superpixel-based grid blending method for data augmentation. To the best of our knowledge, this is the first time that a label mixing strategy using a superpixel attention approach has been proposed for cutmix-based data augmentation. It is the first instance of learning local features from discriminative superpixel-wise regions and cross-image superpixel contrasts. Extensive experiments on various benchmark datasets show that LGCOAMix outperforms state-of-the-art cutmix-based data augmentation methods on classification tasks, {and weakly supervised object location on CUB200-2011.} We have demonstrated the effectiveness of LGCOAMix not only for CNN networks, but also for Transformer networks. Source codes are available at https://github.com/DanielaPlusPlus/LGCOAMix.

数据增强超像素视觉识别Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。