arXiv:2606.25784cs.CV2026-06中稿 · ECCV被引 2

通过自相似补丁重嵌生成标签一致的增强图像,提升模型鲁棒性。

$S^{2}$-FracMix: Label-Preserving Self-Saliency Mixup Augmentation

论文配图:$S^{2}$-FracMix: Label-Preserving Self-Saliency Mixup Augmentation
图 1 · 摘自论文原文
  • 从同一图像中提取多尺度显著区域并重插入非显著区,保持标签一致
  • 在7个基准上实现分类、检测、迁移学习等任务的最优性能
  • 适合需要结构化增强的视觉模型训练,尤其关注鲁棒性与泛化

数据增强能提升深度视觉模型的泛化能力。现有混合策略虽有效,但存在计算开销大且跨样本混合导致语义破坏的问题。本文提出自相似(S²)Mixup,通过提取图像多尺度显著块并重嵌入非显著区域,生成挑战性强且标签一致的样本,促进尺度不变特征学习,避免跨样本干扰。进一步引入FracMix,以自适应比例将自相似模式注入显著区域。整体框架S²-FracMix可在单张图像内同时学习分形与非分形结构,实现目标明确且结构连贯的增强。理论分析证明其优势,实验证明在7个基准上的分类(粗粒度与细粒度)、鲁棒性、校准、目标检测及迁移学习任务中均达当前最优表现。

原文摘要 · Abstract (English)

Data augmentation is known to improve generalization of deep visual models. Recent methods favor mixup strategies that generate interpolated samples to improve model performance. However, these techniques not only incur significant computational overhead, they also lead to semantic disruption of augmentation data due to cross-sample mixing. We first propose Self-Saliency ($S^2$) Mixup, which constructs challenging yet label-consistent samples by extracting multi-scale salient patches and reinserting them into non-salient regions of the same image. This promotes scale-invariant feature learning while avoiding cross-sample interference. To further enhance model robustness, we introduce FracMix, a mixing scheme that injects self-similarity patterns into salient regions using adaptive ratios. Collectively, our unified framework, $S^{2}$-FracMix, enables simultaneous learning from fractal and non-fractal structures within a single image, yielding a targeted and structurally coherent augmentation strategy. We theoretically analyze the advantage of our technique, and empirically establish its superiority over the existing methods by achieving state-of-the-art performance in extensive evaluation with seven benchmarks across classification (coarse and fine-grained), robustness, calibration, object detection, and transfer learning tasks. Project page is available at \href{https://fracmix-data-augmentation.github.io/}{fracmix-data-augmentation.github.io}

数据增强图像生成视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。