arXiv:2604.02946cs.CVcs.AI2026-04被引 1

用合成数据生成过程的来源信息,引导模型关注真实目标区域。

Learning from Synthetic Data via Provenance-Based Input Gradient Guidance

  • 利用合成数据时的来源信息(目标/非目标区域)指导梯度方向。
  • 在多任务多模态实验中显著提升定位与分类性能。
  • 适合需要减少合成偏差、增强模型泛化能力的研究者。

基于合成数据的学习方法因能提升训练数据多样性并降低采集成本,从而增强模型判别鲁棒性而受到关注。然而,现有方法仅通过样本多样化间接提升鲁棒性,未明确指导模型关注输入空间中真正贡献于判别的区域,导致模型可能学习到由合成偏见和伪影引发的虚假相关性。针对这一问题,本文提出一种利用合成过程中获得的来源信息(即输入空间中每个区域是否源自目标对象)作为辅助监督信号的学习框架。具体地,基于合成阶段的目标与非目标区域信息,对输入梯度进行分解,并引入输入梯度引导机制以抑制非目标区域的梯度响应。该机制有效降低模型对非目标区域的依赖,直接促进对目标区域判别性表征的学习。实验表明,该方法在弱监督目标定位、时空动作定位及图像分类等多个任务与模态上均具有有效性与通用性。

原文摘要 · Abstract (English)

Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many existing methods improve robustness only indirectly through the diversification of training samples and do not explicitly teach the model which regions in the input space truly contribute to discrimination; consequently, the model may learn spurious correlations caused by synthesis biases and artifacts. Motivated by this limitation, this paper proposes a learning framework that uses provenance information obtained during the training data synthesis process, indicating whether each region in the input space originates from the target object, as an auxiliary supervisory signal to promote the acquisition of representations focused on target regions. Specifically, input gradients are decomposed based on information about target and non-target regions during synthesis, and input gradient guidance is introduced to suppress gradients over non-target regions. This suppresses the model's reliance on non-target regions and directly promotes the learning of discriminative representations for target regions. Experiments demonstrate the effectiveness and generality of the proposed method across multiple tasks and modalities, including weakly supervised object localization, spatio-temporal action localization, and image classification.

合成数据梯度引导目标定位鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。