arXiv:2510.00434cs.LGcs.CV2025-10被引 1

根据样本对训练的影响动态调整数据增强强度,提升模型泛化能力。

On-the-Fly Data Augmentation via Gradient-Guided and Sample-Aware Influence Estimation

  • 通过梯度投影与局部方差计算,实时评估样本影响并调节增强强度。
  • 在细粒度任务上提升7.3%,长尾数据集上提升4.3%。
  • 无需额外模型或调参,可直接嵌入现有训练流程。

数据增强被广泛用于提升深度神经网络的泛化性能。现有方法多采用固定或随机变换,但我们发现样本难度随模型泛化能力动态演变。若不考虑这一动态性,统一或随机的增强会与模型训练需求错配,降低训练效果。为此,我们提出SADA:一种基于样本感知的动态增强方法,能根据每个样本在优化过程中的演化影响,实时调整增强强度。具体而言,通过将样本梯度投影到累积模型更新方向,并计算局部训练窗口内的时序方差来估计影响。方差低的样本(影响稳定)获得更强增强以增加多样性;方差高的样本(影响不稳定)则接受温和变换以保持语义一致性并稳定学习。该方法轻量高效,无需辅助模型或策略调优,可无缝集成至现有训练流程。在多个基准数据集和模型架构上的实验表明,SADA持续有效,细粒度任务上提升7.3%,长尾数据集上提升4.3%,充分证明其有效性与实用性。

原文摘要 · Abstract (English)

Data augmentation has been widely employed to improve the generalization of deep neural networks. Most existing methods apply fixed or random transformations. However, we find that sample difficulty evolves along with the model's generalization capabilities in dynamic training environments. As a result, applying uniform or stochastic augmentations, without accounting for such dynamics, can lead to a mismatch between augmented data and the model's evolving training needs, ultimately degrading training effectiveness. To address this, we introduce SADA, a Sample-Aware Dynamic Augmentation that performs on-the-fly adjustment of augmentation strengths based on each sample's evolving influence on model optimization. Specifically, we estimate each sample's influence by projecting its gradient onto the accumulated model update direction and computing the temporal variance within a local training window. Samples with low variance, indicating stable and consistent influence, are augmented more strongly to emphasize diversity, while unstable samples receive milder transformations to preserve semantic fidelity and stabilize learning. Our method is lightweight, which does not require auxiliary models or policy tuning. It can be seamlessly integrated into existing training pipelines as a plug-and-play module. Experiments across various benchmark datasets and model architectures show consistent improvements of SADA, including +7.3\% on fine-grained tasks and +4.3\% on long-tailed datasets, highlighting the method's effectiveness and practicality.

数据增强动态优化训练效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。